Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 326 3 v Solution Created 2026-10-03 Updated 2026-10-06
Take with the usual proper closed convex assumptions, so the Fenchel-Moreau theorem identifies its conjugate with the supplied . Put . The first update is . By Moreau decomposition, the second update isAlso , so the argument in the final update contains . Eliminating the auxiliary variable givesThis is the primal-dual hybrid gradient method with extrapolation parameter one and the primal update performed first. Its saddle point function is , corresponding to the primal objective .
For proper lower semicontinuous convex functions and a nonempty saddle-point set in these finite-dimensional spaces, the standard convergence of primal-dual hybrid gradient theorem gives the sufficient parameter conditionHere is the operator norm, or largest singular value. For , one possible choice is with ; for any positive steps satisfy the condition. The existence assumption is necessary: step sizes alone cannot guarantee convergence to a saddle point that does not exist.