Solution

ID: past-exam-of-the-optimisation-for-data-science-course-of-the-university-of-oxford/2023/1/b/solution

Again write and , and let denote its th block of coordinates. The block mixed norm in this part makes the proximal operator separate over blocks. For a single block, its minimiser solves
At a nonzero , the gradient of the Euclidean norm is . The subgradient optimality condition therefore becomes
Thus points in the direction of and . This yields when .
At zero, the subdifferential of the Euclidean norm is the closed Euclidean unit ball: the subgradient inequality is for every , which is equivalent to by the Cauchy-Schwarz inequality and the choice . Hence zero solves the subgradient optimality condition exactly when . This also covers and avoids division by zero.
The resulting radial soft thresholding is
If is the corresponding block of , the required proximal gradient mapping is
Whole blocks can become zero, while nonzero blocks retain their direction after the gradient step. For a block of size one, radial soft thresholding agrees with the soft-thresholding operator in part (a).

New to topics? Read the docs here!