Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2023/iii/paper-205/6/a/solution

Let . Comparing the Lasso objective at and gives the Basic inequality for the Lasso. On it implies
Since
we obtain the Lasso cone condition
The Karush-Kuhn-Tucker conditions also give
so on ,
The assumed cone invertibility condition therefore yields
If , then every active coefficient remains nonzero and retains its sign. Substituting proves
on an event of the required probability. This is Lasso sign recovery from cone invertibility.

New to topics? Read the docs here!