Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 33 4 c Solution Created 2026-10-03 Updated 2026-10-06
An intercept-unpenalized Lasso estimator solves the constrained optimizationFor centered predictors, eliminate the intercept as in ridge regression and minimize under the same constraint. Equivalently, with a suitable tuning parameter , use . The constraint radius and penalty parameter are different parametrizations; larger radius permits less shrinkage.
The Lasso plot parametrizes the Lasso regularization path by the fraction of the maximum norm of the standardized slopes. Unlike the ridge quadratic penalty, the corners of the constraint can place some slopes exactly at zero, providing variable selection. The maximum norm refers to the path's unpenalized endpoint; centering and scaling conventions must match those used to construct that path.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 33 4 d Solution Created 2026-10-03 Updated 2026-10-06
At fraction , the Lasso regularization path lies between the vertical lines marked steps 4 and 5. In that interval the first five predictors have nonzero slopes: are positive and is negative. The sixth predictor remains at zero until the later part of the path, beyond this fraction. Therefore the chosen Lasso model includesThe regression intercept is retained. In particular the negative trace has already left zero at fraction ; a small slope is not the same as a zero slope. The selected fraction came from ten-fold K-fold cross-validation, and is not a numerical value of the ridge penalty in the preceding parts.
Variable selection 2026-10-06
Variable selection chooses which predictor variables enter a statistical model. The Lasso produces exact zero slopes along its Lasso regularization path; ridge regression generally shrinks without excluding variables. Selection for prediction should use predictive cross-validation or another stated criterion, rather than equating a coefficient p-value with practical usefulness.