Compatibility condition for the Lasso 2026-09-24
A compatibility condition lower-bounds prediction norm by a scaled norm on a Lasso cone condition. One convention requires throughout the cone.
Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 205 3 b Solution Created 2026-09-24 Updated 2026-09-25
Write . On , Hölder's inequality givesSince , the triangle inequality givesSubstitution in the Basic inequality for the Lasso, followed by discarding the nonnegative prediction-error term, yieldsTherefore , the Lasso cone condition.
Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 205 3 d Solution Created 2026-09-24 Updated 2026-09-25
Part b places in the Lasso cone condition. Keeping the prediction-error term in the same argument giveswhere the second step is the Cauchy-Schwarz inequality. The restricted eigenvalue condition givesfor nonzero in this cone. Division by provesThe result is immediate when .