Past exam of the mathematics course of the University of Cambridge / 2013 / iii / Paper 28 / 4 / a / Solution

Write $m(\lambda )=\mathbb{E}(X_i\mid \lambda )$ and $v(\lambda )=\mathrm{Var}(X_i\mid \lambda )$. The Bühlmann model uses the finite structural parametersHere $v$ is the expected process variance and $a$ is the variance of hypothetical means. The target is the latent conditional mean $m(\lambda )$, rather than the realized next count. The Bühlmann credibility estimate is the best affine predictor of that target under mean squared error.

The law of total expectation and law of total variance give $\mathbb{E}{X}_i=m_0$ and $\mathrm{Var}(X_i)=v+a$. Conditional independence gives $\mathrm{Cov}(X_i,X_j\mid \lambda )=0$ for $i\ne j$, and the law of total covariance therefore yieldsTo derive the optimal predictor, consider $d=A+{\sum }_{i=1}^n{b}_i{X}_i$. Minimizing with respect to the intercept gives $A=m_0(1-{\sum }_i{b}_i)$. Thus $d=m_0+{\sum }_i{b}_i(X_i-m_0)$. The linear least-squares projection normal equations areFor $v>0$, subtraction of any two equations forces all $b_i$ equal. Substituting a common coefficient then gives $b_i=a/(v+na)$. Equivalently, the mean squared error of the centered predictor is $a-2a{\sum }_i{b}_i+v{\sum }_i{b}_i^2+a({\sum }_i{b}_i{)}^2$, a convex quadratic with precisely these normal equations. HenceThe ratio notation assumes $a>0$; the credibility factor formula $na/(na+v)$ also handles $a=0,v>0$. If $a=0$, the target is the constant $m_0$ almost surely. If $v=0,a>0$, one observation already equals $m(\lambda )$ almost surely, and the average gives it exactly. If both vanish, the target and observations are constant.

The result optimizes over affine functions of the observations. It need not equal the unrestricted posterior mean; exact Bayesian inference generally depends on the whole prior and likelihood, whereas the Bühlmann credibility estimate uses these second-moment structural parameters.