Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-oxford/undated/prelims/mathematics-iii-resit/7/b/i/solution

Differentiate the ordinary least squares objective in a. Its normal equations for linear least squares are
Using and gives
The Hessian matrix of the objective in is , which is positive-definite, so this is its unique global minimum. For the observed estimates, replace by .

New to topics? Read the docs here!