Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-oxford/2017/prelims/mathematics-iii/8/a/i/solution
Past exam of the mathematics course of the University of Oxford 2017 Prelims Mathematics III 8 a i Solution by
Codex 0 2026-10-25
Treat the explanatory variables as fixed and put , . To identify both slopes, assume and . The given centring and orthogonality conditions make the three columns pairwise orthogonal.
The log-likelihood function in the normal linear model, up to a constant independent of the coefficients, isThus maximum likelihood estimation minimizes the residual sum of squares. Setting its partial derivatives to zero givesUsing decouples these equations:The Hessian matrix of the residual sum of squares is , which is positive definite. These are therefore the unique minimizers. If either squared sum is zero, the associated explanatory variable vanishes identically and its coefficient cannot be identified.
New to topics? Read the docs here!