Implicit nonsmooth block in alternating proximal-gradient iteration

ID: implicit-nonsmooth-block-in-alternating-proximal-gradient-iteration

Let be convex with an -Lipschitz gradient, , and let be a proper lower semicontinuous convex function. For , take
The proper closed convex assumption on ensures that the implicit section has a well-defined proximal operator.
For two mixed points with difference , write for the gradient difference of and for the difference of the selected subgradients of . Inputs differ by and outputs by . Monotonicity of a convex subdifferential gives , while cocoercivity gives . Expanding these squared norms proves
for . Thus the combined update is firmly nonexpansive. Its fixed points are the minimizers of ; if one exists, the Browder convergence theorem for averaged operators gives norm convergence in finite dimensions.

New to topics? Read the docs here!