Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2013/ib/paper-2/8h/solution

The Rao-Blackwell theorem says that if is a sufficient statistic and a finite-variance estimator, then is an estimator with the same expectation and no larger variance. Sufficiency ensures the conditional distribution, and hence this formula as a function of the data, does not involve the unknown parameter. The tower property of conditional expectation gives , while the law of total variance gives
This proves the theorem and shows that equality holds exactly when is already determined by , almost surely. In particular, unbiasedness is preserved.
Assume . Independence gives , so the proposed indicator is unbiased and has variance . The type counts are a sufficient statistic: conditional on them, every ordering of the labels is equally likely. Consequently,
For example, the conditional probability of the ordered first three labels is . This is Rao-Blackwellization of a multinomial probability product.
If all three are positive, there is positive probability that all three counts are positive. On such an event the conditional indicator has probability strictly between zero and one, so its conditional variance is positive. Thus for interior parameter values. If any , then and both estimators have zero variance; the printed strict inequality is impossible at those boundary parameters. The valid unrestricted statement is the non-strict inequality.

New to topics? Read the docs here!