Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2010/ii/paper-3/5j/solution

Assume , the ordinary nonsaturated Gaussian linear model. The log likelihood is, up to a constant,
The normal equations and full column rank give the least-squares estimator . Write and , an orthogonal projection of rank . Maximizing in yields
Since , the residual sum of squares is . Expanding its expectation uses only :
This does not use Cochran's theorem. It proves bias and gives
In the saturated case , residuals vanish identically, the likelihood is unbounded as the positive variance tends to zero, and the unbiased residual estimator is unavailable. Thus the usual variance-estimation request requires .

New to topics? Read the docs here!