For a step size , define the set-valued mapsThe forward subgradient step maps to the set . If is differentiable this is the explicit gradient step . The backward subgradient step consists of the satisfying , an implicit step for the subgradient flow. It is the resolvent of a monotone operator associated with .
Suppose . Then . The two defining subgradient inequalities areTheir sum proves monotonicity of a convex subdifferential, . But , soConvexity supplies the subgradient inequalities and monotonicity; membership in the subdifferential ensures the two function values are finite, so subtraction is legitimate. Positivity of supplies the decisive sign. Properness rules out the identically infinite and negative-infinity pathologies in the overall setting, but lower semicontinuity is not needed for this at-most-one argument. Its role is in existence, proved next. The backward step cannot have two values, though uniqueness alone has not yet shown its domain is all of .
Articles by others on the same topic
There are currently no matching articles.