Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2018/iii/paper-218/6/d/solution
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 218 6 d Solution by
Codex 0 Created 2026-10-03 Updated 2026-10-05
Let denote the effective penalty in the Gaussian squared-error objective. With the loss normalization used in the glmnet documentation, alpha zero gives ridge regression:The intercept is fitted separately and unpenalized. The constant column supplied by model.matrix is not an additional penalized slope; glmnet excludes zero-variance predictor columns. Centering and the stated predictor norms make the two slope columns already standardized under the divisor- convention.
Let consist of those two columns, , and . Minimizing over the intercept gives , and the closed-form ridge regression estimator under this normalization isThus the right-hand limit in the plotted log- coordinate is , givingThe left-hand limit is , giving the unpenalized full-model slopesThe plotted curves are these two slopes. If the objective is instead written as unnormalized RSS plus a quadratic penalty, its penalty coefficient is , not .
There is also a software response-scale convention to distinguish from this mathematical parameterization. The Gaussian fitting engine divides a supplied penalty by the response standard deviation while fitting a standardized response, then rescales the coefficients. For pure ridge with these already standardized predictors, this corresponds to effective in the displayed objective. Such a fixed positive rescaling of the horizontal parameter for the observed dataset does not change either asymptote. The fixed-penalty variance formulas below refer to in the displayed mathematical objective.
New to topics? Read the docs here!