Past exam of the mathematics course of the University of Cambridge 2006 iii Paper 42 4 i Solution Created 2026-10-03 Updated 2026-10-14
A natural exponential family of order has an observation vector and probability density function, relative to a fixed reference measure ,Its natural parameter space is . A full natural exponential family allows every . A regular natural exponential family has an open parameter space; fullness and regularity together mean that itself is open. A minimal exponential family additionally requires that no nonzero linear combination of the components of be constant almost surely. This is the condition that the genuinely needed number of canonical sufficient statistics is .
Hölder's inequality shows that is convex: for , its normalizing integral at is at most the product of the respective integrals to powers and . Taking logarithms also proves convexity of the cumulant function . In the minimal case its Hessian matrix is positive definite on the interior, as the covariance calculation below establishes. Keeping fullness, regularity and minimality separate matters when discussing existence or uniqueness of a maximum-likelihood estimator.