Constrained-penalized equivalence for total variation denoising Created 2026-10-06 Updated 2026-10-07
For finite convex total variation and a positive squared-error budget, the Slater condition supplies a multiplier such that every constrained minimizer also minimizes . Conversely, a minimizer of that penalized objective with minimizes total variation under the budget equal to its own squared error. Complementary slackness proves the first implication; a comparison of objective values proves the second. This does not assert uniqueness of the multiplier or equality of all minimizer sets when .
Engquist-Osher method 2026-10-07
The Engquist-Osher method is the finite volume method using the Engquist-Osher flux. Under on the invariant state interval, its update is monotone. It preserves the state range, is contractive for summable perturbations in , and decreases discrete total variation.
The Engquist-Osher method is a conservative finite volume method built by separating positive and negative characteristic speeds. Take , a uniform cell width , a time step , and cell averages . Write and define the numerical flux
The Engquist-Osher flux uses the left state for right-going transport and the right state for left-going transport. Its conservative update is
It is consistent because . The integrals have their ordinary oriented meaning even for negative states. For the Inviscid Burgers equation, gives the useful example
In a region where all characteristic speeds have one sign, the flux reduces to the corresponding upwind flux. In smooth regions, this basic piecewise-constant, forward-time version is first order in space and time; its main virtue is robust nonlinear stability across shocks.
Here is a precise stability proof. Assume the data lie in a bounded interval and choose
Work on a periodic grid, or on the infinite grid with summable differences; on a finite interval the inflow boundary data and boundary fluxes must be treated monotonically as well. Define the three-point update map
Writing and , its three partial derivatives are
Thus it is a monotone conservative scheme. Since , comparison with the constant states proves
The interval is invariant, so the same Courant–Friedrichs–Lewy condition remains valid at every step. This is an bound relative to constant states, not a claim that arbitrary pairs of solutions are contractive in .
For a stronger perturbation estimate, let denote the global update and use componentwise maxima. Monotonicity gives . Therefore
Sum over the grid. The shared interface flux cancels telescopically, so conservation gives
Interchanging and adding yields the L1 contraction of a monotone conservative scheme:
This is a mesh-independent nonlinear stability estimate. On an infinite grid the telescoping argument is justified by summability of the differences and the bounded characteristic-speed range, or by truncation followed by a limit. For unequal prescribed boundary data, additional boundary flux terms enter the estimate.
The method is also a total variation diminishing scheme. Let shift a grid sequence by one cell. Translation invariance gives . Applying the preceding contraction to and shows
Hence initially finite discrete total variation cannot grow.
Finally, monotonicity supplies a discrete entropy inequality, explaining why the stability is compatible with the physically admissible entropy solution. For a constant , define
Comparison of with the clipped triples above and below gives
Indeed and , and subtracting these two update formulas yields exactly the right side. Also , the Kruzhkov entropy flux. Under the displayed CFL condition the method therefore has an invariant state range, contraction, decreasing discrete total variation and entropy dissipation. These estimates remain meaningful at discontinuities, where linearized Fourier analysis alone cannot establish the corresponding nonlinear stability.
Positivity means almost everywhere, since the real logarithm must belong to . A positivity-preserving operator gives . For fixed , the scalar shifted Poisson data fidelity is , with
Composition with the linear operator proves convexity in , and strict convexity holds along pairs whose forward images differ on a set of positive measure. The admissible class itself is convex: the concavity of the logarithm gives , controlling its negative part, while controls its positive part.
Because and , the Jensen inequality gives the requested bound:
The final equality uses nonnegativity and the unit area. Since , this controls the forward-image norm on energy sublevels.
The printed strictly positive problem has no minimizer. This is nonattainment under strict positivity for shifted Poisson fidelity, rather than a failure of the coercivity calculation. Indeed, with and , implies . Also cannot vanish identically for a strictly positive . To see this, let . If , positivity and give . But in and continuity of would imply , contradicting the hypothesis. Thus every admissible has positive fidelity and hence positive total energy.
Conversely, the constants are admissible, have zero total variation, and satisfy
Their logarithms are integrable for each , but the limit is excluded. Therefore
A bounded minimizing sequence and bounded-variation compactness do not repair a nonclosed positivity/logarithm constraint. In particular, a literal existence or uniqueness proof for that domain is impossible.
The natural correction is to minimize over with , omitting the unnecessary condition: the fidelity only contains , which is already integrable. Here is the full existence for nonnegative shifted Poisson regularization argument, also valid for any bounded nonnegative data . Let , , and take a minimizing sequence of energy at most . The displayed bound gives and . Write . The Poincaré inequality for total variation and mean control for positive imaging operators yield
The denominator is nonzero, so the full norm is bounded. Bounded-variation compactness gives in along a subsequence, with . Continuity gives in . On , , so the fidelity converges in the integral; lower semicontinuity of variation completes the direct method in the calculus of variations.
For the actual printed data , the corrected problem has the unique minimizer , even if is not injective. Zero attains energy zero. Any other zero-energy candidate would have both and ; on the connected square, zero variation makes a nonnegative constant, and forces that constant to vanish. For general positive bounded data, an injective is a sufficient uniqueness condition, because its fidelity is strictly convex; injectivity is not a necessary condition in every instance.
In the finite-dimensional interpretation, let . Independent Poisson observations with these intensities have negative log-likelihood . Removing the constant gives precisely the stated fidelity. Thus the model is Poisson counting noise with a unit background intensity, or an approximate version of it for rescaled/continuous grey values. Literal Poisson counts are integers; the constraint is a grey-value normalization, not a literal unscaled count sample.
Let and fix the reference noise budget . Define the convex perturbation function
Positive increases the allowed squared noise level. The feasible epigraph set is convex and closed, so this is a proper lower semicontinuous jointly convex perturbation. Writing the inequality indicator as a supremum over its multiplier gives
The Lagrange dual function is for . In the signed convex conjugate convention of part (a), ; positive gives dual objective because the perturbation can be made arbitrarily large.
The feasible ball is nonempty and compact, so lower semicontinuity of total variation gives a primal minimizer. For , satisfies , providing the Slater condition. Total variation is finite everywhere in the given discretization and hence continuous. Strong duality and dual attainment give a finite optimal . The pair satisfies the Karush-Kuhn-Tucker conditions
Equivalently,
Thus the set of saddle points is nonempty. Compactness handles primal attainment, while strict feasibility supplies a finite multiplier; these are distinct steps. An inactive constraint can yield . At , feasibility still forces , but this strict-feasibility argument does not apply.
Second-order total generalized variation combines a first derivative with an auxiliary vector field and its symmetric derivative. A standard continuous form is
Here denotes the symmetric distributional derivative and the norms are total variations of the corresponding measures. Discrete variants replace these operators by linear maps and use sums of row norms. Unlike first-order total variation, this regularizer accommodates piecewise-affine behavior. A TGV divergence splitting makes its constrained divergence dual amenable to explicit proximal operators.
A translation-invariant conservative monotone update decreases discrete total variation. If is the one-cell shift, , and L1 contraction of a monotone conservative scheme applied to gives . This prevents creation of new total variation, though it does not make every discontinuity sharply resolved.