A sufficient statistic has a conditional law of given independent of the parameter. An ordinary ancillary statistic has a distribution independent of the whole parameter. A partial ancillary statistic for has a law free of , though it may depend on the nuisance parameter . The conditionality principle uses the conditional experiment given the observed value of ; removing additionally requires the conditional law of given to be free of it.
The factorization requested in the PDF expresses this stronger ancillary conditioning that eliminates a nuisance parameter. There is also a normalization typo: the conditional factor must satisfy for each fixed , rather than the printed double sum over and .
Under that nuisance-eliminating interpretation, take to be the parameter-free conditional probability of given , to be the conditional probability of given , and the marginal probability of . The conditional probability rule gives , with the three separate normalizations. Conversely summing over the fibers first gives the joint law , then summing over gives and dividing gives the required conditional law . The factorization also proves sufficiency of .
This equivalence is not valid for ordinary ancillarity alone: a constant is always ancillary, and is sufficient, but conditioning on a constant generally leaves the nuisance parameter present. Thus the distinction matters to the conclusion.
For the independent gamma distributed sample, the joint log-likelihood is
The proposed factorization would write this as a data-only term plus a function of and data plus a function of and data. It would therefore force its mixed derivative to vanish. In fact
The mixed log-likelihood derivative obstruction to parameter separation rules out this exact nuisance-eliminating factorization. It does not rule out ordinary ancillary statistics: a constant statistic still qualifies, and is sufficient for the full two-parameter family.
In a parametric statistical model , the likelihood function measures the relative support given by the observed sample for different parameter values. Maximum likelihood estimation supplies a point estimate; the sampling distributions of suitable statistics calibrate significance tests and confidence intervals. A sufficient statistic retains all parameter-dependent information in the likelihood function, so one first seeks a reduction to such a statistic rather than discarding information arbitrarily.
The characteristic conditioning principle in Fisherian conditional inference is to calibrate inference conditional on the observed value of an ancillary statistic. With no nuisance parameter, a statistic is ancillary when its law is the same for every . Its observed value can nevertheless describe the experimental configuration or precision. Conditional inference uses for an informative statistic , with the observed ancillary value. Since the marginal law of does not depend on , conditioning leaves the parameter-dependent likelihood factor unchanged, while potentially changing the appropriate repeated-sampling reference distribution. Conditioning on a continuous means using a regular conditional distribution, rather than dividing by .
With parameters , where is the target and a nuisance parameter, a fully ancillary statistic has a law independent of both. A partial ancillary statistic for may have a law depending on but not on . To eliminate by conditioning, one needs the actual conditional law of the informative statistic to be free of ; partial ancillarity by itself does not guarantee this. For example, if independent counts have Poisson distributions with means and , their total has Poisson distribution with mean , independent of . The first count conditional on has binomial distribution with parameters . Conditioning removes the nuisance intensity exactly. More generally, nuisance-free pivotal quantities or conditional likelihoods can be used where available; there is no universal conditioning device that removes every nuisance parameter.
For a concrete example of non-uniqueness of maximal ancillary statistics, consider one observed pair , with
Both and have Bernoulli distribution with success probability , independent of , so each is an ancillary statistic. Their generated partitions are different and incomparable. Moreover, each is maximal: refining either two-point cell singles out a point whose probability is or , which is parameter-dependent. Their joint statistic is not ancillary, since . Thus there is no common finer ancillary partition that reconciles the two choices. The conditional laws differ as labelled experiments: and , but they condition on different observed information. This illustrates why “condition on a maximal ancillary” need not specify a unique procedure.
For the location-scale family, write , where the are independent with the fixed density . Let . The transformation gives
and therefore
For , almost surely, because an independent sample from a density has probability zero of all observations coinciding. The right side depends only on a sample from the fixed base law, so the entire vector has a law independent of : No finite population mean or variance is needed for this algebraic argument. With one observation the displayed standardization is undefined, so at least two observations are implicitly required.
The pair together with reconstructs the full sample through . Thus conditional inference in a location-scale family uses
where is the observed residual configuration. Equivalently one can use the parameter-free conditional law of given . To see this explicitly, the centered residual subspace has dimension , so its radial coordinate contributes a Jacobian determinant factor proportional to . The conditional density of , is therefore proportional to
Setting and gives a conditional density proportional to , with no unknown parameter. The normalizing factor can depend on , but not on or . These statements concern almost every attainable ancillary value.