Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 205 5 a Solution Created 2026-09-28 Updated 2026-10-03
With the normalization used in the question, ridge regression solvesDifferentiating with respect to and using the centered columns gives . The normal equation for issoThe push-through identity then gives the equivalent dual form
Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 205 5 c Solution Created 2026-09-24 Updated 2026-09-25
Put . Its ridgeless minimum-norm fit is , so its first coordinates areThe strong law of large numbers applied entrywise gives almost surely as . Continuity of inversion then yieldsalmost surely, where the middle equality is the push-through identity.