For independent affected sib pairs with IBD counts , the likelihood function of the recombination fraction is proportional to , with . At fixed sample size, the total shared-copy count is a sufficient statistic by the Fisher-Neyman factorization theorem. Thus a one-sided likelihood-ratio test has the same ordering as a test for excess mean IBD sharing. This equivalence depends on the stated fully penetrant recessive model and does not extend to arbitrary disease models.
// Target: biology.bigb
For independent multinomial distributions with fixed stratum totals and baseline logits , the sufficient statistics are the displayed response-specific design-weighted counts, . Expanding the log-likelihood gives , plus a data-only term. The Fisher-Neyman factorization theorem therefore proves sufficiency; with an unrestricted identifiable canonical parameter, a likelihood-ratio argument proves minimal sufficiency. Factor indicators give the corresponding response/covariate margins.
Fisher-Neyman factorization theorem Created 2026-09-24 Updated 2026-10-14
Assume the full-data sample space and the range of the statistic are standard Borel spaces, is a measurable function, and the statistical model is dominated by one common sigma-finite measure . Write for its densities. Then is a sufficient statistic if and only if there exist nonnegative measurable functions and , with independent of , such that
The statistical parameter can enter only through and the observed . [ref]
For discrete data, take counting measure; for ordinary continuous data, take Lebesgue measure. Independence, identical sampling laws, smooth dependence on , and a fixed positive support of a probability distribution are not requirements of this theorem. Parameter-dependent support must nevertheless be included in , usually through an indicator function, and must fit the displayed factorization. The sufficient statistic for a symmetric uniform sample illustrates exactly this: its indicator function depends on the unknown scale through the observed absolute maximum. The null sets in the theorem concern versions of densities; the factors are not generally themselves normalized probability distributions.
For a discrete sample space, the cancellation behind the theorem is particularly transparent. On a group with positive probability, factorization gives
Conversely, multiply a common conditional probability mass function by to obtain the required factorization. For continuous data, a sum over a group is not a density integral over the original Lebesgue measure: the group may have measure zero. Use the regular conditional distribution formulation and the Fisher-Neyman factorization theorem instead of that discrete calculation.
For independent normal distribution observations with mean and variance , put , . The Fisher-Neyman factorization theorem makes a sufficient statistic, since the likelihood is proportional to . Its logarithmic derivative has numerator . When , this changes sign once on the positive half-line and gives the displayed global maximum-likelihood estimator. The zero sample is a probability-zero exception with unbounded likelihood as .
Put , . The joint normal distribution density can be written as
The Fisher-Neyman factorization theorem says that, for a family dominated by a common measure, a statistic is a sufficient statistic when its densities have the form with independent of the parameter. The displayed factorization therefore shows that is a two-dimensional sufficient statistic.
For maximum likelihood estimation, discard parameter-independent terms from the log-likelihood:
If , the quadratic equation has exactly one positive root. The numerator is positive before that root and negative after it, while the likelihood tends to zero at both ends of . Hence the normal likelihood with variance equal to squared mean gives the global maximizer
This holds almost surely. The exceptional all-zero sample has and likelihood proportional to , so its supremum is approached as and there is no positive maximizer.
For the standard additive multinomial logistic regression, use the final satisfaction category as baseline and write
Set a reference effect to zero for each covariate factor. Define for , and . The probabilities are
Substitution into the conditional log-likelihood gives
The second term depends on the parameters and the fixed stratum totals, not on any additional within-stratum cell allocation. The Fisher-Neyman factorization theorem therefore proves that
These margins contain linear redundancies; after reference constraints an equivalent independent statistic has dimension
Hence its residual degrees of freedom are . In the equivalent Poisson surrogate for a conditional multinomial model, include a separate stratum intercept and response interactions with each individual covariate. The 24 nuisance intercepts plus 14 response parameters give 38 parameters in 72 Poisson cells, again 34 residual degrees of freedom. Since the stratum totals are fixed in the conditional experiment, they need not be included as random sufficient statistics there; they do belong to the unconditional Poisson model's sufficient margins.
For a dominated family of sample distributions, a statistic is a sufficient statistic precisely when the probability mass function or density factors as
where does not depend on the parameter. This is the Fisher-Neyman factorization theorem.
Here is the discrete proof in both directions. Suppose the factorization holds, and write . Then . Whenever this probability is positive, is finite and positive and
is independent of . Thus the conditional distribution of the whole sample given is parameter-free, which is the definition of a sufficient statistic.
Conversely, if is sufficient, let denote this common conditional mass function on each possible fiber. Then
Take and to obtain the factorization. Fibers impossible for every parameter can be assigned ; conditional probabilities are required only for fibers with positive probability.
For the independent Poisson sample the joint mass function is
All parameter dependence is through
so this is a one-dimensional sufficient statistic. The sample mean contains the same information, since is known.
Put , and . Apart from a data-only constant, the log-likelihood is
The natural parameters in the ambient two-parameter exponential family of normal distributions are and , restricted to the nonaffine curve , . Its parametrization has rank one. Thus this is a one-dimensional curved exponential family inside a two-dimensional full family.
The Fisher-Neyman factorization theorem makes sufficient. For two samples , the parameter-dependent part of their log density ratio is . A polynomial in is constant on only if both nonconstant coefficients vanish. The likelihood-ratio criterion for minimal sufficiency therefore proves is minimal sufficient.
Write with independent . Since , has a probability distribution independent of : it is an ancillary statistic. The denominator is nonzero almost surely. The Cauchy-Schwarz inequality gives ; on the requested positive branch, and .
The likelihood equation is . Its positive root is
There is exactly one positive root. The sign of the score function changes from positive to negative there, and at both ends of when , so it is the unique maximum-likelihood estimator. The useful identities are
Substitution yields, dropping the constant ,
Differentiating twice and using at the fitted value gives the observed information
The scalar P-star approximation uses . Consequently, with its normalizing factor explicitly retained,
Here is chosen to make the density integrate to one, and is independent of . To see this without assuming an approximate normalizer, define
The integral is finite and positive, and normalized is exactly
Indeed .
There is a direct check of this conditional scale density in a curved Gaussian family. In polar coordinates , the sample density times volume element is proportional to . Conditioning on fixes . The remaining angular factor is independent of , while . Thus the exact conditional radial density has the same normalized form. For the positive ancillary branch fixes the positive sign and the same one-dimensional radial calculation applies. In this scale model the normalized expression equals the exact conditional density, not merely its leading approximation.
For , compute its conditional distribution by one-dimensional quadrature:
It is zero for ; with the conditional-density calculation just given, this normalized formula is exact for almost every admissible . Numerically, subtract the maximum log integrand before exponentiating to avoid overflow. The sampling probability still depends on the stipulated true ; replacing it by a fitted value would be a separate plug-in inference step.
Put and . The usual recombination fraction range gives , and the preceding likelihood function becomes
To see its relation to nonparametric linkage analysis, use Bayes' theorem and the constant disease probability to obtain the affected-pair marker-sharing probabilities
Their multinomial likelihood has exactly the same -dependent kernel, since its extra factor is constant. Set and . Then , and is the total number of shared ancestral copies. At fixed , the Fisher-Neyman factorization theorem makes a sufficient statistic. The observed mean shared proportion is , and the binomial likelihood kernel gives
The unlinked null is , whereas linkage corresponds to , or expected shared proportion . If , the constrained likelihood is maximized at the unlinked null. For , its log likelihood ratio is
whose derivative in is . Hence it orders samples exactly by excess IBD sharing. Under this fully penetrant recessive model, parametric linkage testing and a one-sided test of the overall IBD-sharing proportion use the same information. This is allele-sharing sufficiency for recessive linkage, not a general equivalence for all disease models. Use limiting values for terms such as , and assume for the estimators.
A sufficient statistic for is a function of the observations whose conditional distribution of given does not depend on , whenever that conditioning event is possible. It retains all parameter dependence of the likelihood.
In the discrete case the Fisher-Neyman factorization theorem provides a direct criterion: , where is independent of the parameter. To justify sufficiency, for a value with positive probability, sum this expression over its fiber and divide:
The parameter-dependent factor cancels. Conversely, parameter-independent conditional probabilities give the factorization with . Thus the criterion is both necessary and sufficient, with conditional laws only required on fibers of positive probability.
For the shifted exponential sample the likelihood is
It factors through , so the sample minimum is a sufficient statistic. Writing , independence gives for
Therefore is exponential with rate . Its mean is and its variance is . The unbiased endpoint estimator for a shifted exponential sample is consequently
Although the parameter is nonnegative, this unbiased estimator can be negative. Truncating it at zero would change its expectation and lose the requested property of an unbiased estimator.
An exponential family has density on a parameter-independent support. For an independent and identically distributed sample, its likelihood factorizes through , so the Fisher-Neyman factorization theorem gives a sufficient statistic whose dimension is the fixed dimension of , independent of sample size.
Expanding the normal log-density gives , , and
The mean-value parameter is , hence
For and positive sample variance, and , so . For this normal natural-mean parameter ratio estimator, the central limit theorem gives asymptotic independent errors for and , with variances and . Applying the delta method to yields
If is known, is fixed and has exact distribution . The variance-estimation contribution disappears.
Let . The Kolmogorov-Smirnov statistic is , often reported as . Under the simple null, the probability integral transform makes independent uniform variables on . Strict monotonicity and continuity identify the empirical distribution under this change of coordinates, so
Its null law is therefore independent of .
For the composite null, the joint density is . Its parameter dependence is only through , proving sufficiency by the Fisher-Neyman factorization theorem; the larger statistic is sufficient too. Ties have probability zero. For fixed , the density of is , , because the other coordinates range independently over . Dividing the joint density by this marginal gives conditional density
Thus the remaining observations are conditionally independent .
For , discard the maximum and apply the Kolmogorov-Smirnov test to the ratios , , against . Use the ordinary null critical values for sample size . Its conditional, hence unconditional, level is independent of . Keeping the fitted maximum and using the ordinary -sample critical values would not have that justification.
A complete statistic for a family if every measurable with and for all satisfies almost surely under every . It is boundedly complete if the same implication is required only for bounded measurable . Completeness therefore implies bounded completeness.
The vector is multivariate normal with mean zero and covariance
Its determinant is and its inverse is . Hence the joint density is
The Fisher-Neyman factorization theorem gives sufficiency. For minimality use the likelihood-ratio criterion for minimal sufficiency. The density ratio for is independent of precisely when
is constant. Multiplying by shows that its constant would produce a quadratic term on the right whereas the left is linear, so that constant is zero. The remaining coefficients give . Thus is minimal sufficient statistic.
Each is standard normal, so . The integrable, nonzero function has zero expectation for every parameter, proving that is not complete.
By sufficiency, choose a version common to all parameters. The tower property gives
On the event we necessarily have , so there almost surely. This event has positive probability under every parameter because the joint normal density is strictly positive on a ball about the origin. Thus is not identically . The bounded function has zero expectation for every parameter but is not almost surely zero. Consequently
Given the complete stopped sample , the likelihood function is
The stopping factor is positive and independent of . The Fisher-Neyman factorization theorem makes sufficient. For two possible stopped samples of lengths and sums , their likelihood ratio is a parameter-free factor times . This is independent of exactly when and : differentiating its logarithm gives for all . By the likelihood-ratio criterion,
The likelihood principle says proportional likelihoods give the same evidence about the parameter. Thus with the full sample observed, this parameter-free stopping rule adds no likelihood evidence beyond the realized values and length; it gives the same likelihood-based inference as a fixed-length sample with those values. This statement does not assert that frequentist sampling distributions are unchanged.
Let be the chance of stopping at a given stage. Independence of successive stages gives
Therefore and give the requested exponential family form.
Writing , differentiation in gives . Integrating and using shows . Likewise
The stipulated vanishing of at both boundaries gives
These integrations require the displayed moments and integrals to exist, the usual regularity interpretation of the question; when establishing a finite variance this assumption should be explicit.
Differentiating the normalization in gives and . The score function is , so the Fisher information is . The Cramér-Rao bound states that a regular unbiased estimator of has variance at least . Apply it to :
Equivalently differentiate and use the Cauchy-Schwarz inequality to get , which gives the same conclusion.
A statistic is a sufficient statistic for if the conditional distribution of the data given does not depend on . For a dominated family with density or mass function , the Fisher-Neyman factorization theorem states that this is equivalent to
where is nonnegative and independent of , and is nonnegative and depends on the data only through .
For a discrete sample space, suppose first that the factorization holds. If , summing over the fibre gives , so
This conditional distribution is independent of , proving that is a sufficient statistic. Conversely, let be the common conditional mass function guaranteed by the sufficient statistic property, for every fibre attainable under at least one parameter. Set and . Then . Fibres never attained under any parameter can be assigned any conditional distribution, since their multiplying probability is always zero. This proves both directions of the discrete criterion, including possible parameter-dependent supports.
Write , and . The joint probability density factors as
By the Fisher-Neyman factorization theorem, is a sufficient statistic. The same factorization shows that the smaller statistic is also a sufficient statistic. This gives the sufficient statistic for a symmetric uniform sample.
In fact, the likelihood-ratio criterion for minimal sufficiency identifies as a minimal sufficient statistic: two sample points with the same have identical likelihoods for all ; with different , their likelihoods have different parameter supports, and so are not proportional as functions of . Equivalently, the condition that for every and some positive constant holds exactly when their absolute maxima agree.
To see rigorously that cannot be recovered from almost surely, fix any . The sample has a distribution invariant under simultaneous sign reversal. If almost surely, the same identity would hold for the sign-reversed sample on another probability-one set. Since is unchanged by sign reversal, it would follow that
and hence almost surely. But this event has probability zero for a finite sample from a continuous uniform distribution: it entails for some pair of indices, including the possible case . Therefore is not a function of the sufficient statistic . The pair of extrema is not minimally sufficient, for every , even though it is sufficient.
A sufficient statistic has a conditional distribution of the full data given its value that is independent of the unknown parameter. A minimal sufficient statistic is sufficient and is a function of every other sufficient statistic, up to null sets. For a dominated family with common positive support, the likelihood-ratio criterion for minimal sufficiency states that is minimal sufficient if holds exactly when is independent of .
For , the joint probability mass function is
The Fisher-Neyman factorization theorem proves sufficiency of . For two samples, the likelihood ratio is , independent of exactly when their sums agree. Thus is minimal sufficient. Any one-to-one transformation of it is also minimal sufficient, so choose
This chosen estimator is an unbiased estimator, since each observation has mean . If instead the statistic is reported as , its expectation is , and as an estimator of it has bias (zero only when ). Being a minimal sufficient statistic is unchanged by this rescaling; being an unbiased estimator is not.
Since , the indicator is an unbiased estimator of . The joint probability mass function is
The Fisher-Neyman factorization theorem therefore makes a sufficient statistic. More explicitly, conditioning on gives a multinomial distribution with trials and cell probabilities , so has the binomial distribution . Consequently conditioning by the Rao-Blackwell theorem gives
For , interpret the value at as and at as ; thus the same expression uses in this probability convention. For all observations and are zero almost surely. For and , the reduction in variance is strict: given , the event still has a nondegenerate conditional probability. Directly, using the probability generating function of , the new variance is .
For , define the class degree sum
and define the number of within-college friendships by
Each between-college edge contributes once to the degree sum of each endpoint's college, while each within-college edge contributes twice to its college's degree sum. The model-3 likelihood can therefore be written
The Fisher-Neyman factorization theorem shows that is sufficient.
For two networks , the likelihood ratio is
Because the parameters range independently over , this ratio is constant in exactly when every displayed difference vanishes. The likelihood-ratio criterion for minimal sufficiency therefore gives the answer
This is the degree-sum sufficient statistic for an additive logistic network model.
A statistic is sufficient for if the conditional distribution of the full sample given does not depend on . It is minimal sufficient if it is a function of every sufficient statistic.
The likelihood factors as
so the Fisher-Neyman factorization theorem shows that , and hence its one-to-one transform , is sufficient. Moreover, for two samples and , the ratio is independent of exactly when their maxima agree. The likelihood-ratio criterion for minimal sufficiency therefore shows that and are minimal sufficient.
For , the sample mean is not sufficient: two samples can have the same mean but different maxima, and their likelihood ratio then depends on through the support indicators. It is consequently not minimal sufficient. For the degenerate special case , the sample mean and maximum coincide and both conclusions reverse.