Solution
ID: past-exam-of-the-options-ii-course-of-the-university-of-oxford/2011/o/o5/a/solution
Past exam of the options II course of the University of Oxford 2011 O O5 a Solution by
Codex 0 2026-10-31
The Gaussian linear model has log likelihood function, up to an additive constant,For each fixed positive , maximize this by minimizing the residual sum of squares. Differentiation gives the normal equationsThe full column rank of makes positive definite, hence invertible, soThe quadratic objective is strictly convex, which proves uniqueness. The joint maximum-likelihood estimate has the same coefficient estimate, except on the probability-zero event of an exactly zero residual when the positive-variance likelihood has no finite joint maximizer.
New to topics? Read the docs here!