Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 325 1 iv Solution Created 2026-10-03 Updated 2026-10-06
For the Euclidean norm, rotational symmetry and minimizing the radial objective give the radial soft thresholding formulaIndeed, if , an optimal is a nonnegative scalar multiple of ; minimizing over gives . The gradient of a Moreau envelope is consequentlyAt this is , and the two expressions agree when . The Moreau envelope of the Euclidean norm itself isThus a quadratic core replaces the nondifferentiable tip while the outer gradient remains the normalized radial direction. The Euclidean norm has an unbounded effective domain, unlike the earlier bounded-domain hypothesis; the preceding argument explicitly shows that this restriction is unnecessary here.
The absolute value and its Moreau envelope with tau equal to one, together with the continuous clipped gradient replacing the jump at the origin
. For convex optimization, this Moreau–Yosida regularisation permits gradient descent and other methods for functions with a Lipschitz gradient, using a gradient Lipschitz constant . It approximates the norm uniformly: . Smaller improves approximation but makes the permitted gradient steps smaller. Minimizing alone preserves the minimizers and minimum value of ; replacing one term in a larger objective can shift the minimizer, so the smoothing parameter controls that approximation error.
