Use the maximizing-dual convention. For the perturbation function , defineThe primal problem is ; the Lagrangian dual problem is . The sign convention makes the dual marginal concave for jointly convex data; some formulations negate to express a minimization problem.
The central convex perturbation duality calculation isThe last inequality is weak duality. A sufficient finite-dimensional condition for strong duality with dual attainment is: is jointly proper and convex, is proper with finite, and is finite on a neighborhood of zero. More generally suffices.
Indeed continuity of a convex function on the interior of its domain gives a supporting subgradient , soTherefore and the dual maximum is attained. This qualification establishes equality and dual attainment; it does not by itself establish a primal minimizer.
For each fixed , choose the convex perturbation functionIt is jointly convex and has marginalBecause and are nonnegative and finite everywhere,for every . The inf-convolution is convex: for approximate decompositions of , take their convex combination and use convexity of both costs; then let their approximation errors tend to zero. Thus is a finite convex function on all of , hence continuous everywhere. In particular is proper and finite near zero, so the qualification in the previous solution applies at every :This is strong duality for a finite-valued infimal convolution.
No primal attainment was used. For example and meet all the stated assumptions, but is approached only as . This illustrates why a proof based on an assumed minimizing decomposition would be incomplete. The printed functions are real-valued everywhere, not merely extended-real; that distinction supplies continuity and the strong-duality qualification.
Compute the convex conjugate of at a general pair . With , the independent variables become and , soTherefore the Lagrange dual function isUsing strong duality from the preceding solution givesEquivalently the conjugate of an infimal convolution is , and the continuous convex equals its biconjugate.
For practical subgradient computation, minimize the known convex dual objectiveEvery optimizer, and only an optimizer, belongs to by Fenchel–Young inequality. The full characterization isThis is infimal-convolution dual subgradients; the set is nonempty because is finite convex everywhere. If both conjugates are differentiable at the optimizer, solve . For nonsmooth conjugates, use the displayed aggregate subdifferential or a convex minimization algorithm. Replacing it by requires the usual subdifferential sum rule qualification; it is not automatically justified solely by knowing the two conjugates.
Articles by others on the same topic
There are currently no matching articles.