Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2016/ib/paper-4/19h/a/solution

Let . Under the usual nondegenerate regression assumption , maximizing the normal likelihood is equivalent to minimizing the residual sum of squares. The normal equations and give the maximum-likelihood estimators
Write and . Then , , and the residual is . Independence of the errors gives
For each ,
Thus the three requested variables are pairwise uncorrelated.
They are linear functions of the jointly normal error vector. More strongly, the whole vector has a multivariate normal distribution, and its block covariances show that , and the residual vector are independent, by uncorrelated jointly normal variables are independent. Independence is preserved when applying a measurable function to the residual block. Hence
The residual projection is , of rank , so additionally . This is the orthogonal projection of a Gaussian vector interpretation of the same result. The printed design conditions alone allow ; then the fit is exact, the positive-variance likelihood has no finite maximizer, and the residual test in part (b) is undefined. The standard testing question therefore needs .

New to topics? Read the docs here!