Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2023/iii/paper-218/5/a/solution

For fixed , letting gives ridge regression, including ordinary least squares when ; letting forces every coefficient to zero. For fixed , letting gives the Lasso. Letting both penalties vanish gives an ordinary least squares solution, unique when has full column rank and otherwise potentially nonunique or path-dependent.
When , the term is strictly convex. Its sum with the convex squared loss and penalty is strictly convex and coercive, so the elastic net solution exists and is unique.

New to topics? Read the docs here!