Basu's theorem 2026-10-14
A complete sufficient statistic is independent of every ancillary statistic. To prove this, let be complete and sufficient, let be ancillary, and take any bounded measurable function . By sufficiency, has a parameter-independent version; by ancillarity, is independent of . Thus for every . Completeness gives almost surely. Choosing to be the indicator of each measurable event in the ancillary space proves independence. Completeness is essential: a sufficient statistic may itself contain a nonconstant ancillary, as in the minimum and maximum of a uniform location sample.
Conditionality principle 2026-10-14
When an experiment's configuration is observed, inference conditions on the experiment actually performed rather than averaging over its possible configurations. Conditioning on an ancillary statistic is a central application; freedom from a nuisance parameter must still be checked in the resulting conditional distribution.
In a parametric statistical model, the likelihood function compares parameter values, while sampling distributions calibrate tests and confidence intervals. A sufficient statistic retains the parameter information. Conditioning on an observed ancillary statistic restricts that calibration to experiments with the same ancillary configuration, instead of averaging over configurations whose distribution is unrelated to the parameter. Since the ancillary's marginal law is parameter-free, conditional and unconditional likelihoods have the same parameter-dependent factor. With a nuisance parameter, a conditional law or pivotal quantity must remove it before inference for the parameter of interest can use a nuisance-free reference law.
Location-scale family 2026-10-14
In a location-scale family, for a fixed base probability distribution of , with and . Location translates observations, and scale multiplies their deviations. For an independent sample with a base density and at least two observations, the normalized residual vector , where , is an ancillary statistic. Indeed, and , making the residual vector a function of the base sample alone. This algebraic result needs no population moments.
A maximal ancillary statistic has no strictly finer ancillary partition of the sample space, but different maximal ancillary partitions can exist. Let take values in , with probabilities on each equal pair and on each unequal pair, for . Both and have the Bernoulli distribution with success probability for every . Their joint law depends on , so combining them is not ancillary. Each partition is maximal: splitting one of its two-point cells singles out a point whose probability depends on . There is no common ancillary refinement, and conditioning on one ancillary choice need not specify a unique conditioning principle for all models.
For a parameter of interest and nuisance parameter , a partial ancillary for has a marginal law independent of , possibly depending on . This differs from a fully ancillary statistic, whose law is independent of both. For independent Poisson counts with means and , their total is Poisson with mean , while the first count conditional on the total is binomial with success probability . Conditioning on the total eliminates . A partial ancillary does not automatically eliminate a nuisance parameter; the conditional law must actually be free of that parameter.