The forward subgradient step and backward subgradient step are the set-valued mapsThus means . They are respectively the explicit and implicit time discretizations of subgradient flow . At a differentiable point the forward update is , while the backward update evaluates the gradient at the new point. For proper closed convex data the latter is the proximal operator
To prove at most one output, suppose . Then and . The two subgradient inequalities imply monotonicity of a convex subdifferential, givingSince , . Convexity supplies this monotonicity; lower semicontinuity is not needed for this at-most-one argument.
Under the full printed assumptions the output actually exists at every . Properness ensures a finite point and excludes . Proper lower-semicontinuous convex has an affine minorant, so the quadratic proximal objective is coercive. Lower semicontinuity makes its minimum attained on a compact sublevel set. Convexity and the positive quadratic curvature make it strongly convex, hence its minimizer is unique. The subgradient optimality condition, with the differentiable quadratic term, is exactly . ThusThis also identifies precisely which assumptions provide existence, uniqueness and the update's optimality interpretation.
LetThe proximal operator optimality condition saysBy subgradient inversion under convex conjugacy, which uses Fenchel–Young inequality and from the Fenchel-Moreau theorem,Consequently , meaning . Uniqueness of the backward subgradient step identifies the result:This is the scaled Moreau decomposition. It requires one backward step on , with reciprocal parameter and scaled input , followed by a scalar multiplication and subtraction. No separate proximal computation of the convex conjugate is needed.
Articles by others on the same topic
There are currently no matching articles.