Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2014/iii/paper-68/2/solution

Interpret the printed Euclidean norm literally on the full vector array . It is a single global norm, not the sum of pixelwise gradient lengths in discrete isotropic total variation. Set and let be its exact adjoint operator for the chosen difference and boundary conventions. The closed dual ball and its image signal are
The set is nonempty, convex and compact, hence closed, because it is a linear image signal of a compact ball in finite dimensions. Euclidean norm duality gives
the support function of .
The metric projection onto a closed convex set uniquely minimizes over . Its variational characterization of convex projection says
Put . This inequality says precisely that . For any , the primal energy satisfies
Completing the square shows that the right side is uniquely minimized by . At that point the inequality is equality, so
This also follows from the proximal operator of a support function and Moreau decomposition: the convex conjugate of is the indicator functional of a constraint set for . The squared fidelity is strictly convex and coercive, so the primal minimizer exists and is unique.
The convex projection in this formula is the removed component , not generally itself. A metric convex projection onto one fixed closed convex set is idempotent. On a right singular vector direction with positive singular value of any nonzero , this denoising map reduces to soft thresholding with a positive threshold, and applying it twice shrinks again. It therefore cannot be such a convex projection for all data. This qualifies the printed convex projection wording while giving the required global gradient-norm projection residual.
Compute by solving the convex dual least-squares problem
Its gradient is and has Lipschitz constant . Projected gradient descent gives
For fixed , the finite-dimensional projected-gradient convergence theorem ensures that converges to a dual minimizer. Reconstruct ; its limit is the unique primal solution even if dual minimizers are nonunique. If , the primal solution is simply and no iteration is needed. For unit-grid forward differences with periodic or zero-difference boundaries, , so is sufficient. Grid-spacing factors or other boundary stencils change this bound.
The normalization here is global. If a pixelwise sum of gradient lengths had instead been intended, the dual feasible set would be a product of pixelwise balls and convex projection would normalize each block separately; it is a different regularizer and should not be silently substituted.
For the discrete Hessian-norm denoising variant, write and use
This is again a compact convex image signal of a Euclidean ball, now under the second-difference adjoint. In suitable conventions is a discrete double divergence, but its exact boundary adjoint is what defines the set. It lies in , so components in are preserved by denoising. Interior second derivatives annihilate affine image signals; whether all such image signals remain in the kernel depends on the boundary convention. With a pixelwise Hessian norm, the corresponding balls would instead be four-component blocks.

New to topics? Read the docs here!