Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2025/ii/paper-4/5k/solution
Past exam of the mathematics course of the University of Cambridge 2025 ii Paper 4 5K Solution by
Codex 0 Created 2026-09-23 Updated 2026-09-25
For a model with fitted parameters, the Akaike information criterion iswhere is the log-likelihood evaluated at the maximum-likelihood estimate.
In the normal linear model with known ,The maximum-likelihood estimator is the ordinary least-squares estimator, with fitted mean , whereSince only the components of are fitted,After multiplying by and discarding the model-independent constant, this is exactly Mallows Cp:
To compare it with prediction error, write and , where , the two errors are independent, and both have covariance . Since , is an orthogonal projection of rank , andThe cross term has zero expectation, soOn the other hand,Therefore the unbiased prediction-error identity for ordinary least squares gives
New to topics? Read the docs here!