Past exam of the mathematics course of the University of Cambridge 2008 ii Paper 1 27I Solution Created 2026-09-24 Updated 2026-10-14
For the fixed observation interval, has Poisson distribution with mean and variance . Hence is unbiased and has variance . Its score function is , and its Fisher information is . The Cramér-Rao bound for unbiased estimation of therefore gives variance at least , attained by .
For the stopping-time observation, has Gamma distribution with shape and rate . Direct integration of its density givesThus , andThe score function is , so the Fisher information is . Its Cramér-Rao lower bound is , strictly below this estimator's variance.
Nevertheless, is uniformly minimum-variance unbiased. The observed is a sufficient statistic, and its family is complete: if for all , then for all . Uniqueness of the Laplace transform, applied after an exponential tilt to make an Lebesgue integrable function, implies almost everywhere. The Lehmann–Scheffé theorem now proves the minimum-variance assertion. Failure to attain the Cramér–Rao bound does not disprove minimum variance within the class of unbiased estimators.
For the actual observations, the two likelihood functions areThey differ by a factor independent of . The likelihood principle consequently requires the same inferential conclusions, since the observed data carry proportional likelihoods. But the two minimum-variance unbiased estimates are respectively. Minimum-variance unbiased estimation therefore violates the likelihood principle: its unbiasedness and variance refer to the sampling plan, including the stopping rule, rather than solely to the observed Likelihood function.
Past exam of the mathematics course of the University of Cambridge 2011 ii Paper 3 27K Solution Created 2026-09-24 Updated 2026-10-14
Given the complete stopped sample , the likelihood function isThe stopping factor is positive and independent of . The Fisher-Neyman factorization theorem makes sufficient. For two possible stopped samples of lengths and sums , their likelihood ratio is a parameter-free factor times . This is independent of exactly when and : differentiating its logarithm gives for all . By the likelihood-ratio criterion,The likelihood principle says proportional likelihoods give the same evidence about the parameter. Thus with the full sample observed, this parameter-free stopping rule adds no likelihood evidence beyond the realized values and length; it gives the same likelihood-based inference as a fixed-length sample with those values. This statement does not assert that frequentist sampling distributions are unchanged.
Let be the chance of stopping at a given stage. Independence of successive stages givesTherefore and give the requested exponential family form.
Writing , differentiation in gives . Integrating and using shows . LikewiseThe stipulated vanishing of at both boundaries givesThese integrations require the displayed moments and integrals to exist, the usual regularity interpretation of the question; when establishing a finite variance this assumption should be explicit.
Differentiating the normalization in gives and . The score function is , so the Fisher information is . The Cramér-Rao bound states that a regular unbiased estimator of has variance at least . Apply it to :Equivalently differentiate and use the Cauchy-Schwarz inequality to get , which gives the same conclusion.