Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 205 / 3 / d / Solution

Part b places $\delta =\hat{\beta }-{\beta }^0$ in the Lasso cone condition. Keeping the prediction-error term in the same argument giveswhere the second step is the Cauchy-Schwarz inequality. The restricted eigenvalue condition givesfor nonzero $\delta$ in this cone. Division by $\Vert \delta {\Vert }_2$ provesThe result is immediate when $\delta =0$.