Take with the usual proper closed convex assumptions, so the Fenchel-Moreau theorem identifies its conjugate with the supplied . Put . The first update is . By Moreau decomposition, the second update is
Also , so the argument in the final update contains . Eliminating the auxiliary variable gives
This is the primal-dual hybrid gradient method with extrapolation parameter one and the primal update performed first. Its saddle point function is , corresponding to the primal objective .
For proper lower semicontinuous convex functions and a nonempty saddle-point set in these finite-dimensional spaces, the standard convergence of primal-dual hybrid gradient theorem gives the sufficient parameter condition
Here is the operator norm, or largest singular value. For , one possible choice is with ; for any positive steps satisfy the condition. The existence assumption is necessary: step sizes alone cannot guarantee convergence to a saddle point that does not exist.