Fisher-Neyman factorization theorem Created 2026-09-24 Updated 2026-10-14
Assume the full-data sample space and the range of the statistic are standard Borel spaces, is a measurable function, and the statistical model is dominated by one common sigma-finite measure . Write for its densities. Then is a sufficient statistic if and only if there exist nonnegative measurable functions and , with independent of , such thatThe statistical parameter can enter only through and the observed . [ref]
Sufficiency (Stat 210a, Fall 2025) by Will Fithian. Sufficiency, Will Fithian, “Factorization theorem”: common dominating measure and almost-everywhere factorization
For discrete data, take counting measure; for ordinary continuous data, take Lebesgue measure. Independence, identical sampling laws, smooth dependence on , and a fixed positive support of a probability distribution are not requirements of this theorem. Parameter-dependent support must nevertheless be included in , usually through an indicator function, and must fit the displayed factorization. The sufficient statistic for a symmetric uniform sample illustrates exactly this: its indicator function depends on the unknown scale through the observed absolute maximum. The null sets in the theorem concern versions of densities; the factors are not generally themselves normalized probability distributions.
For a discrete sample space, the cancellation behind the theorem is particularly transparent. On a group with positive probability, factorization givesConversely, multiply a common conditional probability mass function by to obtain the required factorization. For continuous data, a sum over a group is not a density integral over the original Lebesgue measure: the group may have measure zero. Use the regular conditional distribution formulation and the Fisher-Neyman factorization theorem instead of that discrete calculation.
Past exam of the mathematics course of the University of Cambridge 2016 ib Paper 1 19H c Solution Created 2026-09-24 Updated 2026-10-06
Write , and . The joint probability density factors asBy the Fisher-Neyman factorization theorem, is a sufficient statistic. The same factorization shows that the smaller statistic is also a sufficient statistic. This gives the sufficient statistic for a symmetric uniform sample.
In fact, the likelihood-ratio criterion for minimal sufficiency identifies as a minimal sufficient statistic: two sample points with the same have identical likelihoods for all ; with different , their likelihoods have different parameter supports, and so are not proportional as functions of . Equivalently, the condition that for every and some positive constant holds exactly when their absolute maxima agree.
To see rigorously that cannot be recovered from almost surely, fix any . The sample has a distribution invariant under simultaneous sign reversal. If almost surely, the same identity would hold for the sign-reversed sample on another probability-one set. Since is unchanged by sign reversal, it would follow thatand hence almost surely. But this event has probability zero for a finite sample from a continuous uniform distribution: it entails for some pair of indices, including the possible case . Therefore is not a function of the sufficient statistic . The pair of extrema is not minimally sufficient, for every , even though it is sufficient.