For a logarithmically homogeneous barrier on a proper cone, the convex conjugate with reversed argument defines a barrier on the interior dual cone. The inverse gradient relation makes equivalent to . This gives a joint primal-dual central path without assuming the barrier is identical on a self-dual cone.
Lower conjugate 2026-10-14
The lower conjugate uses an infimum, unlike the supremum defining a convex conjugate. For any , and . The inequality is informative only when the lower conjugate is finite. If the infimum is attained uniquely and the dual is differentiable, is its minimizing argument. This sign convention is useful for upper comparison-energy bounds.
Moreau decomposition 2026-09-28
For , the generalized Moreau decomposition is , where is the convex conjugate.
In the Voigt elastic approximation, every local strain is . The corresponding local stress is . Differentiating the averaged strain energy density under the integral gives
The uniform strain need not generate an equilibrated local stress; this calculation concerns the stated approximation, not an assertion that it solves the heterogeneous boundary problem.
For the Reuss elastic approximation, use the convex conjugate
Under differentiable strictly convex duality, the local strain produced by uniform stress is . Set . Averaging the local strains gives . At the maximizing stress in , the stationarity condition is precisely . Consequently
Thus the derivative of each approximate energy is its own mean stress, including
For positive linear elasticity, and , giving the useful check and . More general convex duality gives the same conjugacy relation with subgradients when differentiability or strict convexity is absent.
Let . Maximizing a linear functional over this line segment occurs at an endpoint, so
This identifies as a support function. Its convex conjugate is the indicator functional : if , then for every , with equality at zero; if , strict separation and positive scaling of the separating vector make the supremum infinite.
For a convex function, equality in the Fenchel–Young inequality characterizes its subdifferential. Hence
This is support-function subgradients as exposed faces. In particular a maximizing really is a subgradient, since for every .
Writing , with , now gives
If , the last line is the singleton , so the formula includes that case.
Compute the convex conjugate of at a general pair . With , the independent variables become and , so
Therefore the Lagrange dual function is
Using strong duality from the preceding solution gives
Equivalently the conjugate of an infimal convolution is , and the continuous convex equals its biconjugate.
For practical subgradient computation, minimize the known convex dual objective
Every optimizer, and only an optimizer, belongs to by Fenchel–Young inequality. The full characterization is
This is infimal-convolution dual subgradients; the set is nonempty because is finite convex everywhere. If both conjugates are differentiable at the optimizer, solve . For nonsmooth conjugates, use the displayed aggregate subdifferential or a convex minimization algorithm. Replacing it by requires the usual subdifferential sum rule qualification; it is not automatically justified solely by knowing the two conjugates.
Let
The proximal operator optimality condition says
By subgradient inversion under convex conjugacy, which uses Fenchel–Young inequality and from the Fenchel-Moreau theorem,
Consequently , meaning . Uniqueness of the backward subgradient step identifies the result:
This is the scaled Moreau decomposition. It requires one backward step on , with reciprocal parameter and scaled input , followed by a scalar multiplication and subtraction. No separate proximal computation of the convex conjugate is needed.
The convex Legendre transform, or convex conjugate, is
For a differentiable strictly convex function, an attained maximum is characterized by , and then at that maximizing .
For the affine covariance of the convex conjugate, assume and substitute :
Hence
Positive scaling is necessary for this supremum definition, although the printed formula does not specify it. For example, and give , not the finite expression . If the transform is instead defined as a stationary value using a locally invertible gradient, the same algebraic identity holds for any : the critical-point relation is , and substitution of that stationary gives the displayed formula. That extension does not assert a supremum for negative scaling.
For the positive-definite quadratic form, symmetry and positive eigenvalues of give
The second term is nonpositive and vanishes exactly at . Therefore
For an extended-real function define its Fenchel conjugate by and its biconjugate by . The Fenchel-Moreau theorem states, in the standard proper-envelope setting,
Here the right side is the largest lower semicontinuous convex function below , equivalently the function whose epigraph is the closed convex hull of . It is enough to assume is proper and has an affine minorant, ensuring this envelope is proper. In particular, for a proper convex function that is lower semicontinuous, .
First, by the definition of the convex conjugate. The biconjugate is a supremum of continuous affine functions, so it is convex, lower semicontinuous and no greater than . Second, the best intercept for an affine minorant with slope is : for all precisely when . Thus is the supremum of all affine minorants.
To prove that no part of the closed convex envelope is missed, set . The half-space representation of a closed convex set from part (a), applied in , separates any from by an inequality . Because is upward closed, . If , division by gives an affine minorant with .
A vertical separator has . Let be an existing affine minorant. Combine with to obtain
Since , a sufficiently small positive makes this affine function exceed . Thus vertical half-spaces can be approximated by nonvertical epigraph supports. Every point below the envelope is excluded by an affine minorant, so the supremum of these minorants is exactly the envelope. This is the decisive use of part (a).
Properness and the minorant convention matter for unrestricted extended-real functions. For example, on has no affine minorant; and . With the corresponding improper-envelope convention its closed convex envelope is also . The theorem should not silently describe such an envelope as proper. The identically function is another degenerate case, handled separately by extended-real conventions.
Let and fix the reference noise budget . Define the convex perturbation function
Positive increases the allowed squared noise level. The feasible epigraph set is convex and closed, so this is a proper lower semicontinuous jointly convex perturbation. Writing the inequality indicator as a supremum over its multiplier gives
The Lagrange dual function is for . In the signed convex conjugate convention of part (a), ; positive gives dual objective because the perturbation can be made arbitrarily large.
The feasible ball is nonempty and compact, so lower semicontinuity of total variation gives a primal minimizer. For , satisfies , providing the Slater condition. Total variation is finite everywhere in the given discretization and hence continuous. Strong duality and dual attainment give a finite optimal . The pair satisfies the Karush-Kuhn-Tucker conditions
Equivalently,
Thus the set of saddle points is nonempty. Compactness handles primal attainment, while strict feasibility supplies a finite multiplier; these are distinct steps. An inactive constraint can yield . At , feasibility still forces , but this strict-feasibility argument does not apply.
Interpret the printed Euclidean norm literally on the full vector array . It is a single global norm, not the sum of pixelwise gradient lengths in discrete isotropic total variation. Set and let be its exact adjoint operator for the chosen difference and boundary conventions. The closed dual ball and its image signal are
The set is nonempty, convex and compact, hence closed, because it is a linear image signal of a compact ball in finite dimensions. Euclidean norm duality gives
the support function of .
The metric projection onto a closed convex set uniquely minimizes over . Its variational characterization of convex projection says
Put . This inequality says precisely that . For any , the primal energy satisfies
Completing the square shows that the right side is uniquely minimized by . At that point the inequality is equality, so
This also follows from the proximal operator of a support function and Moreau decomposition: the convex conjugate of is the indicator functional of a constraint set for . The squared fidelity is strictly convex and coercive, so the primal minimizer exists and is unique.
The convex projection in this formula is the removed component , not generally itself. A metric convex projection onto one fixed closed convex set is idempotent. On a right singular vector direction with positive singular value of any nonzero , this denoising map reduces to soft thresholding with a positive threshold, and applying it twice shrinks again. It therefore cannot be such a convex projection for all data. This qualifies the printed convex projection wording while giving the required global gradient-norm projection residual.
Compute by solving the convex dual least-squares problem
Its gradient is and has Lipschitz constant . Projected gradient descent gives
For fixed , the finite-dimensional projected-gradient convergence theorem ensures that converges to a dual minimizer. Reconstruct ; its limit is the unique primal solution even if dual minimizers are nonunique. If , the primal solution is simply and no iteration is needed. For unit-grid forward differences with periodic or zero-difference boundaries, , so is sufficient. Grid-spacing factors or other boundary stencils change this bound.
The normalization here is global. If a pixelwise sum of gradient lengths had instead been intended, the dual feasible set would be a product of pixelwise balls and convex projection would normalize each block separately; it is a different regularizer and should not be silently substituted.
For the discrete Hessian-norm denoising variant, write and use
This is again a compact convex image signal of a Euclidean ball, now under the second-difference adjoint. In suitable conventions is a discrete double divergence, but its exact boundary adjoint is what defines the set. It lies in , so components in are preserved by denoising. Interior second derivatives annihilate affine image signals; whether all such image signals remain in the kernel depends on the boundary convention. With a pixelwise Hessian norm, the corresponding balls would instead be four-component blocks.
Normalize the constant relative risk aversion utility as . The printed specification of alone also permits an additive constant ; that would add to the value, so the stated homogeneity holds for the normalized value. Set
Multiplying initial wealth, the historical maximum, dollar investments, and consumption by multiplies every term of the wealth equation by , including the tax term. It maps admissible policies bijectively and multiplies the normalized reward by . Therefore the value scales as
The historical maximum means when initially .
Inside the state region , the maximum is locally constant. The Hamilton-Jacobi-Bellman equation is
At , the finite-variation contribution in the Itô formula is . The high-water mark tax boundary condition is consequently
For an increasing, strictly concave function of wealth, optimizing the two controls gives
The consumption convex conjugate is
Substitution of the homogeneity derivatives gives the reduced equation and boundary condition
The controls in scaled variables are and .
Use the wealth-variable Legendre dual
Since , the inverse map satisfies and . Inserting into the reduced Hamilton-Jacobi-Bellman equation gives a linear Euler equation
For the Euler differential equation operator on the left, its action on is . Write . Under , the particular solution is . For the nondegenerate case , the two characteristic roots are , with because and . Thus the general solution also contains .
Here and the relevant dual domain is . The inverse wealth ratio must have as . The particular solution and the negative-root term have derivatives tending to zero, whereas has an unbounded derivative unless . Hence the admissible dual solution has the claimed form
The quadratic-root formulation presupposes a nonzero market price of risk. If , the dual equation becomes first order; it is treated directly or by an appropriate nondegenerate limit rather than by assuming two quadratic roots.
The inverse map and the tax boundary provide two equations at :
Because , these become
Let . Eliminating gives . Also , since puts strictly between the two roots. The derivative boundary then gives . Therefore the constants are
There is an important admissibility qualification in the printed conclusion. With ,
The second term is negative, but decays faster than the first because . Direct differentiation at the boundary gives
A wealth-variable Legendre dual of a concave value must be a convex function. Thus the printed smooth tax-paying solution requires , with the limiting case allowed as a degenerate boundary. The assumptions and do not imply this: for example , , , , and give and , hence negative boundary dual curvature.
For higher tax the investor can avoid raising the historical maximum. The wealth-cap investment boundary replaces the tax-paying equality by , alongside . Solving these equations gives
These are the same constants with replaced by . More generally the admissible two-regime expression uses
in the constants, while the claimed formulas themselves describe the tax-paying regime. In the cap regime the portfolio volatility vanishes at and the consumption rate there is , so the wealth drift points inward and no new maximum is required. The remaining boundary inequality is , consistent with avoiding costly maximum increases. For , dual curvature is positive because the negative term in decays faster than the positive term. Thus this qualification repairs an actual missing parameter restriction rather than a TeX transcription error.
In congestion control, resource observes only its own aggregate load and generates the nonnegative feedback price . User receives the sum of prices along its route. Its desired increase competes with the congestion charge , while sets the adjustment speed. This is local information: a resource needs the rates passing through it, and a user needs the feedback along its own route, rather than the complete network state.
There is a hypothesis to make explicit before claiming global convergence. If “increasing” means nondecreasing, the printed assumptions allow , in which case and there is no equilibrium point. The intended theorem holds when every route contains at least one resource whose price is not identically zero, with nonempty routes and nonnegative, continuous, nondecreasing prices. Strictly increasing prices satisfy this condition automatically. We prove the theorem under this necessary qualification; without it the zero-price example disproves the literal claim.
Let . Each is a nonnegative convex function. For positive rates define the primal congestion potential
The weighted logarithmic utility is a strictly concave function, and subtracting the resource costs preserves strict concavity. Thus has at most one maximizer and at most one critical point on the positive orthant.
It also attains its maximum there. A nonzero nondecreasing price is bounded below by some positive constant at all sufficiently large loads; hence its primitive satisfies with . Choose at zero-price resources. The route coverage assumption gives , so
This bounds all superlevel sets of . Within a bounded set, approaching makes . Consequently every nonempty superlevel set is a compact set contained in the positive orthant. A maximizing sequence stays in one such set, giving a unique interior maximizer . Its critical-point equations are
The rate dynamics are the gradient flow with diagonal mobility . Along any positive trajectory,
with equality only at . Thus is a strict Lyapunov function. The initial superlevel set traps the trajectory away from both infinity and the boundary, ensuring global continuation. Positive initial rates remain positive: variation of constants in makes this explicit. Starting with finite nonnegative rates also gives positive rates at every later positive time.
For completeness, mere continuity of suffices for convergence; one need not silently assume differentiable prices. On the trapping compact set, both the vector field and are continuous and bounded. The trajectory satisfies a uniform Lipschitz condition in time, so is uniformly continuous. Also , since increases to a finite limit. The decay of a nonnegative uniformly continuous integrable function applies: otherwise disjoint intervals of a fixed positive width would each contribute a fixed positive amount. Every accumulation point therefore has and is . Compactness then proves the global convergence
This is the dissipation argument behind the LaSalle invariance principle. If uniqueness of trajectories is desired under continuous prices, put . The transformed equation is . The transformed potential is concave: it is a sum of positive multiples of , minus convex nondecreasing composed with nonnegative quadratic sums. Its gradient is monotone decreasing, so the squared distance between two solutions cannot increase. This proves uniqueness for positive initial data without a locally Lipschitz function hypothesis on .
For the alternative price dynamics, restrict first to positive prices on resources used by at least one route, and discard unused resources. Define the dual congestion potential
Its domain has and for every route. Strictly increasing make each strictly convex, and is convex. Thus is a strictly convex function. Each is eventually bounded below by a positive constant, so its integral grows at least linearly, dominating the negative logarithms as . If a route price tends to zero in a bounded set, . Therefore attains a unique minimum on its domain including the admissible boundary faces.
That minimum has every used-resource price positive. At a face , all route prices are still positive and the inward derivative is
Hence the minimum cannot lie on that face. At the unique interior minimum,
Since the price dynamics are , their positive equilibrium points are exactly these critical points. There is one equilibrium in the positive price domain. An unused resource instead has its only nonnegative equilibrium at zero.
The positive-domain qualification matters here even with strictly increasing . If zero prices are admitted, the multiplicative factor permits boundary equilibria of multiplicative price dynamics. Take one route using two resources, , and . Both and are equilibria, with , as is the positive equilibrium , with . Thus the literal assertion of uniqueness on the whole nonnegative orthant is false. A boundary equilibrium need not satisfy load equals supplied capacity at its zero-price resources.
The relationship between the two intended equilibria is inverse resource response. The first system has ; the positive equilibrium of the second has . If on the relevant ranges, these are the same resource equations, and both systems also impose . They therefore have the same rates and prices. For strictly increasing continuous with and unbounded range, the ordinary inverses satisfy all the stated conditions on . With arbitrary independently chosen and , the equilibria need not agree. Under inverse response, and are convex conjugates on the nonnegative half-line, and supplies the Lagrangian dual problem for maximizing the weighted logarithmic utility minus resource costs, up to constants independent of .
Write for the infimal convolution. It is proper by the permitted hypothesis. If and are finite, choose within of their respective infima. For , put and . Convexity of and gives
Let . If either endpoint value is infinite, the desired inequality is automatic. Thus the infimal convolution is convex, without assuming the infimum is attained.
For its convex conjugate, replace a negative infimum by a supremum and then change variables :
The two suprema separate because and are independent. Properness of and makes each supremum strictly greater than , so this separation remains valid when one or both are . Therefore . This is the conjugate of an infimal convolution. The bounded-domain assumption is unnecessary for these two calculations; the assumed properness and lower semicontinuity of will be used when applying subgradient inversion under convex conjugacy.
For the convex conjugate, use a dual scalar to avoid confusing it with the fixed centre . Differentiating gives , so the unique maximizing point is . Substitution yields
The positivity of makes the maximized quadratic strictly concave and the convex conjugate finite for every real .
For a real Banach space and a proper convex function , the convex conjugate is the extended-valued function on the continuous dual space
Here proper means that never takes and is finite somewhere. The pairing is the duality pairing, or the inner product after identification in a Hilbert space. The conjugate is convex and lower semicontinuous because it is a supremum of continuous affine functions. Its definition gives the Fenchel–Young inequality ; the Fenchel-Moreau theorem recovers as under the stated closed-convex hypotheses.
For the absolute value function, for all if , with equality at . If , taking with makes the expression diverge. Thus its convex conjugate is
This is the indicator functional of a constraint set for the dual unit interval, not a zero-one indicator function.
By the definition of the subdifferential, means
Rearrangement bounds by , and equality is attained at . Taking the supremum in the definition of the convex conjugate gives . Conversely this equality bounds every member of that supremum and rearranges to the subgradient inequality. Therefore
Apply the same argument to and use the Fenchel-Moreau theorem . With the canonical Hilbert identification of the bidual, the equality is also equivalent to . This proves subgradient inversion under convex conjugacy:
The conditions include finiteness at the points in question; expressions involving are not subgradients merely by formal subtraction.
Write and use the real pixelwise inner products. Let be the adjoint operator, defined by . For each nontrivial grid direction its one-dimensional formula is
with the analogous formula in for . Their sum is ; unused components and do not contribute. For , . If discrete divergence is defined, its sign convention is , as in the adjoint of a discrete forward gradient.
Define the compact convex set and its image . The image is compact and convex, hence closed, and contains zero. The finite-dimensional Euclidean duality formula , applied independently at every pixel, gives
Thus the penalty is the support function . Its convex conjugate is the indicator functional of a constraint set , equal to zero on and infinity elsewhere. For , the conjugate supremum is zero; for , the separation theorem supplies a direction with , and scaling that direction makes the supremum infinite.
The proximal operator is . It exists uniquely because the objective is continuous, coercive and strictly convex. The Moreau decomposition for a proper closed convex function gives . The second term is the Euclidean projection onto a convex set, so the projection residual for discrete total variation is
Alternatively, the variational characterization of convex projection says exactly when for every . Hence attains the support function at , giving and the same optimality condition. This supplies a direct verification of the Moreau decomposition step in this instance.
The printed wording needs “the residual after a projection”, rather than “the projection itself”. In general this denoising map is not a projection onto any fixed closed convex set. A metric projection onto a closed convex set is idempotent, while denoising a sufficiently large jump twice shrinks it twice. Concretely, for and data with rows and , the minimizer has rows and . Reapplying the map gives rows and , so it is not idempotent. These formulas have a global certificate: take , all other dual entries zero, giving with rows and ; it saturates every positive row difference and yields the primal optimality condition. The qualification is therefore not merely a consequence of a restricted two-level ansatz.