Past exam of the mathematics course of the University of Cambridge 2023 ii Paper 1 13J ii Solution Created 2026-09-24 Updated 2026-09-25
Because is an orthogonal projection of rank ,It follows that Mallows Cp satisfieswhere the last equality is part (i). Thus is an unbiased estimator of the independent-copy prediction error, as summarized by the unbiased prediction-error identity for ordinary least squares.
Past exam of the mathematics course of the University of Cambridge 2025 ii Paper 4 5K Solution Created 2026-09-23 Updated 2026-09-25
For a model with fitted parameters, the Akaike information criterion iswhere is the log-likelihood evaluated at the maximum-likelihood estimate.
In the normal linear model with known ,The maximum-likelihood estimator is the ordinary least-squares estimator, with fitted mean , whereSince only the components of are fitted,After multiplying by and discarding the model-independent constant, this is exactly Mallows Cp:
To compare it with prediction error, write and , where , the two errors are independent, and both have covariance . Since , is an orthogonal projection of rank , andThe cross term has zero expectation, soOn the other hand,Therefore the unbiased prediction-error identity for ordinary least squares gives