Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2023/iii/paper-205/6/solution

With the convention matching the constants below, the Lasso estimator is any minimizer
Because , the centered noise has the same score as : . Each is sub-Gaussian with scale , so
For , a union bound over the columns yields
Call this event .
The Karush-Kuhn-Tucker conditions for the Lasso say that there is such that
Equivalently, belongs to the subdifferential of the norm at .

New to topics? Read the docs here!