Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 32 6 iii Solution Created 2026-10-03 Updated 2026-10-14
A finite-dimensional exponential family has common dominating measure and densityHere is the natural parameter of an exponential family, and normalization determines the cumulant function of an exponential family . A full regular family lets vary over an open natural parameter domain. A curved exponential family restricts to a lower-dimensional submanifold, while a minimal representation removes redundant affine combinations of the statistic.
Differentiating the normalization under regularity givesConsequently is convex and its Hessian is the Fisher information matrix in natural coordinates. For an independent size- sample, is a sufficient statistic: the joint density factors into times , so the conditional law given loses its parameter dependence. An interior maximum-likelihood estimator solvesmatching empirical and theoretical sufficient-statistic means. Under minimality the Hessian is positive definite, so the log-likelihood is strictly concave; existence of an interior maximizer still needs the observed statistic to be in the appropriate interior convex support.
For a full open natural family, the canonical sufficient statistic is a complete statistic: if throughout the open domain, exponential tilting about an interior point makes the Laplace transform of the integrable signed measure zero on a neighborhood. Transform uniqueness makes that measure zero, so almost surely. This requires integrability under the family. It is not an automatic property of curved restrictions. The sufficient-statistic reduction, explicit information and cumulant identities make these families especially useful for exact and higher-order inference. Normal distributions, Poisson distributions and gamma distributions supply familiar examples.
A transformation model is built differently: a group acts on the sample and parameter spaces, and its probability laws satisfyIn a transitive model all laws are transforms of a fixed reference law. The location family is generated by translations, with density . The positive-scale family has density , and the location-scale family combines them asThe Jacobian factor is essential. For independent observations its power is . The base density need not have moments, and a transformation model need not have fixed support.
An equivariant estimator respects the parameter action. With a well-defined equivariant fit valued in the transformation group, the normalized sampleis a maximal invariant. Equivariance gives ; if normalized samples agree, is obtained from by . In a transitive transformation model its law is parameter-free, so it is an ancillary statistic. For location and positive scale, centered standardized residuals provide this construction on nondegenerate samples. If the parameter action has a nontrivial stabilizer, normalization must retain its quotient action rather than pretending that a unique group element is determined.
This geometry motivates conditioning on an ancillary and using the P-star approximation for the fitted parameter. Ancillarity means parameter-free distribution; it does not by itself assert independence from the estimator. In a normal location model with known scale, the sample mean and centered residuals are independent by their joint Gaussian law and zero covariance. In an exponential scale model, the sample sum and its normalized proportions are independent, again an additional model property.
The two classes overlap but are distinct. A normal location-scale family is both an exponential family and a transformation model; an exponential mean family is both a one-dimensional natural exponential family and a scale model. A general Cauchy distribution location family is a transformation model without a fixed finite-dimensional regular exponential-family sufficient-statistic reduction. Exponential-family structure emphasizes sufficient statistics and natural-parameter convexity; transformation structure emphasizes equivariance, group orbits and ancillary reduction.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 33 3 a Solution Created 2026-10-03 Updated 2026-10-06
For , write the Poisson distribution mass function in exponential dispersion family form:Thus the natural parameter of an exponential family is and the dispersion parameter is fixed at . The counting-measure support is ; there is no independent free dispersion parameter in an ordinary Poisson model. The degenerate boundary is obtained as a limit, rather than a finite natural parameter.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 206 4 a Solution Created 2026-10-03 Updated 2026-10-06
For , the Bernoulli distribution has massIn exponential dispersion family notation , takeThe support is ; outside it the probability is zero. The natural parameter of an exponential family is the log odds, and the dispersion parameter is fixed rather than freely estimated. Differentiating the cumulant givesAt or the degenerate distributions are limiting boundary cases with natural parameter or .
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 213 3 Solution Created 2026-10-03 Updated 2026-10-06
Use an ideal carrier-sense multiple access scheme on the interference graph. An active station finishes its transmission after an independent unit-rate exponential distribution waiting time. An inactive station has an independent attempt clock with an exponential distribution of rate ; an attempt succeeds only when all its neighbors are inactive. Attempts that are blocked do not change the state. Thus, on the independent sets represented by , the continuous-time Markov chain has transition ratesThe empty independent set can be reached by successive deactivations, and any other independent set can be reached from it by successive activations. Hence this finite chain is an irreducible Markov chain. The weight satisfiesBy detailed balance for a continuous-time Markov chain, its unique stationary law isThis is a finite exponential family. Its natural parameter of an exponential family is and its mean parameter of an exponential family is the vector of active fractions.
The throughput region of an interference graph is exactly . To see the possibly less immediate inclusion, suppose a random feasible schedule has mean . Retain each of its active vertices independently with probability , interpreting zero coordinates as always deleted. A subset of an independent set remains an independent set; the thinned schedule has mean exactly . Thus lies in the convex hull of . The opposite inclusion follows from the definition using equality. Moreover , so this convex hull has full dimension.
Now choose such that remains in the interior of . Use interior moment matching in a finite exponential family. Consider the convex functionThere is a ball of radius around contained in . Maximizing a linear functional over the convex hull is the same as maximizing over its generating set, so, for every ,The last inequality uses the point when . Hence is a coercive function and has a finite minimizer . Differentiating the finite normalizing sum givesThis covariance matrix is a positive-definite matrix: a linear functional constant on all states of positive weight must be constant on , so its coefficients vanish. Thus is a strictly convex function; its minimizer is unique. At that minimizer the desired strict service margins areFor a backlogged station that transmits at unit speed whenever active, the long-run throughput is , by the ergodic theorem for a finite continuous-time Markov chain. Therefore the ideal carrier-sense multiple access scheme can supply a strict service margin for every arrival vector in the interior of the throughput region of an interference graph. The local attempt rates can realize the whole interior capacity region in this sense. Boundary points may require parameters tending to infinity, and the argument gives no uniform delay or mixing-time bound near the boundary.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 1 b Solution Created 2026-10-03 Updated 2026-10-05
For fixed known , take the natural parameter of an exponential familyThe negative binomial distribution has log-likelihoodThus this is a negative binomial exponential family, with dispersion parameter in the convention of part (a). The carrier contains the Gamma function and depends on the fixed size , which need not be an integer. Differentiating the cumulant function of an exponential family givesThereforeThe size controls overdispersion relative to a Poisson distribution; it is different from the unit dispersion parameter used by this fixed-size generalized linear model. Another common convention applies to the scaled response : then and . Keeping track of the response scale prevents confusing these two representations. At the law is concentrated at zero and is obtained as a boundary limit, rather than by a finite natural parameter of an exponential family.
Past exam of the mathematics course of the University of Cambridge 2019 ii Paper 1 5J Solution Created 2026-09-24 Updated 2026-09-29
An exponential dispersion family has densities of the formwhere is the canonical parameter, is the dispersion parameter, and the support does not depend on . Its mean and variance are
For the given Gamma distribution, setThengivesThus the gamma laws form the Gamma exponential dispersion family.
Directly integrating, or using the cumulant-generating function of a gamma distribution,soDifferentiation at zero yields
Past exam of the mathematics course of the University of Cambridge 2020 ii Paper 4 13J a Solution Created 2026-09-24 Updated 2026-09-29
A generalized linear model assumes independent responses from one exponential dispersion family,where , , and a link function relates the mean to the linear predictor by . It follows from normalization of the density after shifting the natural parameter thatIndependence therefore gives the joint moment-generating functionwhenever every shifted natural parameter lies in its natural-parameter domain.
Past exam of the mathematics course of the University of Cambridge 2021 ii Paper 1 5J Solution Created 2026-09-24 Updated 2026-09-25
Expand the exponent in the Inverse Gaussian distribution with unit shape parameter:Consequently its probability density function can be written aswhereIndeed, . This is the canonical form of a one-parameter exponential family, and its natural parameter is therefore
Past exam of the mathematics course of the University of Cambridge 2022 ii Paper 2 5J a Solution Created 2026-09-24 Updated 2026-09-25
A one-parameter exponential family has densitieswith support independent of the natural parameter . In the present canonical setting the natural statistic is .
Past exam of the mathematics course of the University of Cambridge 2023 ii Paper 1 5J Solution Created 2026-09-23 Updated 2026-09-25
For , the last flip must be the th head. Among the preceding flips, exactly are tails and are heads. There are choices for their positions, and every resulting sequence has probability . The negative binomial stopping argument therefore givesso has the failures-before-the-th-success negative binomial distribution.
To put the mass function into exponential family form, setSince ,whereThus the natural parameter of an exponential family is , and the Fisher-Neyman factorization theorem shows that is a sufficient statistic. This is the negative binomial exponential family.
Past exam of the mathematics course of the University of Cambridge 2023 ii Paper 3 5J Solution Created 2026-09-23 Updated 2026-09-25
A one-parameter exponential family with natural statistic has density or probability mass functionwhere is the natural parameter of an exponential family and is the cumulant function of an exponential family. Its mean parameter is
The exponential-family deviance from to is twice the Kullback-Leibler divergence:The carrier cancels from the likelihood ratio, so, with ,
For the Poisson distribution with mean ,ThereforeWriting and applying the Taylor series of givesso the second-order approximation is