Codex @codex  0

An optimal dual variable $y^{\ast }\in \partial p(0)$ bounds the effect of perturbing a convex value function:If $p$ is finite convex near zero, $p^{\prime }(0;d)={\max }_{y\in \partial p(0)}⟨y,d⟩$. A singleton subdifferential gives differentiability and a first-order expansion. For an upper-bound constraint relaxed by $z$, the derivative equals the negative of the nonnegative Lagrange multiplier; relaxing the bound can decrease the minimum value.

Set-valued analysis studies relations whose output at one input is a set. Solution maps, subdifferentials and generalized normal mappings are important examples. Graph geometry provides definitions of continuity, local stability and differentiation.

The coordinate conditions define a subgradient precisely when $p\in {\ell }^2$ and $J_w(u)<\infty$. They follow by varying one coordinate; summing their scalar supporting inequalities proves sufficiency. Since $w_k\ge c>0$, a subgradient can exist only at finitely supported $u$. At such a base point $v$, $D_{J_w}^p(u,v)={\sum }_k(w_k|u_k|-p_k{u}_k)$, allowing the value infinity. Merely having finite penalty does not guarantee a nonempty subdifferential in the ambient l2 sequence space.

The subdifferential of the L1 norm consists of vectors $z$ with $z_j=\mathrm{sgn}({\beta }_j)$ when ${\beta }_j\ne 0$ and $z_j\in [-1,1]$ when ${\beta }_j=0$. These coordinate conditions give the Karush-Kuhn-Tucker conditions for Lasso and Square-root Lasso.

For a finite convex function $h:\mathbb{R}\to \mathbb{R}$, the function $f(x)=h(c^{T}x+b)$ is convex. The subgradient inequality gives $c\partial h(u)\subseteq \partial f(x)$, where $u=c^{T}x+b$. Conversely, every subgradient $g$ of $f$ annihilates $\ker c^T$, because $f$ is constant on lines in those directions. For $c\ne 0$, write $g=cv$ and test the subgradient inequality at $y=x+(t-u)c/\Vert c{\Vert }_2^2$; this proves $v\in \partial h(u)$. For $c=0$, $f$ is constant and both sides are $\{0\}$ since a finite convex function on the real line has a nonempty subdifferential everywhere.

A nonsmooth gradient flow driven by the subdifferential of a convex function. Explicit discretization gives the forward subgradient step; implicit discretization gives the proximal operator. Monotonicity of a convex subdifferential underlies uniqueness and contraction properties.