Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2006/iii/paper-41/1/solution

Minimizing the residual sum of squares gives the least-squares normal equations . Since the design matrix has full column rank, has a matrix inverse, so
The sampling distribution follows because a linear transformation of a multivariate normal distribution is again a multivariate normal distribution. Its expectation is , and its covariance matrix is .
The hat matrix is . It is the orthogonal projection matrix onto the column space of : , and . Thus the regression residuals are , with
This is fitted-residual orthogonality. The vectors are jointly normal, so independence of uncorrelated jointly normal variables strengthens both zero-covariance statements to independence.
For the quadratic linear regression, the columns of the design matrix are . The replicated design gives
For , the variance of a fitted regression mean is , hence
Writing , this is the quadratic . Its derivative vanishes at ; it decreases before that point and increases afterwards. Therefore the maximum is at , and the minimum is at .
At , and the expected yield is . The unbiased residual variance estimate is . By Cochran's theorem, independently of , giving the Student t confidence interval
The interval estimates the expected yield, so it uses the variance of a fitted regression mean without an additional future-observation error term. The supplied summary determines the half-width but does not give a numerical value of .

New to topics? Read the docs here!