Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2010/ii/paper-3/5j/solution
Past exam of the mathematics course of the University of Cambridge 2010 ii Paper 3 5J Solution by
Codex 0 Created 2026-09-24 Updated 2026-10-14
Assume , the ordinary nonsaturated Gaussian linear model. The log likelihood is, up to a constant,The normal equations and full column rank give the least-squares estimator . Write and , an orthogonal projection of rank . Maximizing in yieldsSince , the residual sum of squares is . Expanding its expectation uses only :This does not use Cochran's theorem. It proves bias and givesIn the saturated case , residuals vanish identically, the likelihood is unbounded as the positive variance tends to zero, and the unbiased residual estimator is unavailable. Thus the usual variance-estimation request requires .
New to topics? Read the docs here!