Bounded-variation contraction under clipping Created 2026-10-05 Updated 2026-10-06
For and , and . This is the contraction property of a one-Lipschitz scalar composition, obtainable by smooth approximation and sequential lower semicontinuity. It proves range preservation for total variation denoising when the data lie in .
In the formulation of total variation denoising on the entire plane, one may allow finite distributional total variation seminorm on a domain without requiring global membership. Its extended penalty is a supremum of continuous test-function pairings and hence is sequentially lower semicontinuous. This domain can be larger than , since the usual bounded-variation space includes an condition.
A Huber loss applied to a discrete gradient combines quadratic penalization of small slopes with linear penalization of large slopes. This interpolates between squared-gradient smoothing and total variation denoising, allowing smooth regions while retaining an edge-preserving large-gradient regime. The threshold should be chosen consistently with the signal's units and discretization. It can reduce staircasing in total variation denoising without guaranteeing its elimination.
Assume minimizes scalar total variation denoising for . The data may be unbounded. For the local flow of , use as two competitors. The total variation under opposite smooth flows and convexity of the total variation seminorm bound the sum of regularizer changes by . Minimality and the opposite-flow fidelity identity for quadratic data, evaluated using the BV jump-product limit with one bounded factor, imply
Let . The integrands define finite signed Radon measures, since is bounded and the jump variation of is finite. Arbitrary nonnegative smooth make their densities nonnegative. Testing every coordinate direction removes the factor and proves the stated inequality.
For scalar total variation denoising with on a bounded Lipschitz domain in arbitrary dimension, the inequality holds with common oriented BV traces on a hypersurface. It says that every surviving jump has the same direction as its data jump and no larger amplitude. Reversing the normal changes both differences and preserves the inequality.
Use residual-preserving clipping of an ROF minimizer and the jump-amplitude inequality for a bounded ROF minimizer. At each finite jump, choose an integer clipping level above both output traces. The clipped function has those same traces, and its residual-adjusted data have the same traces as . Taking a countable union over the integer clipping levels proves the result. This gives the no-new-jumps property of total variation denoising under the full assumptions, without asserting regularity of unbounded-forcing perimeter minimizers.
For scalar total variation denoising with on a bounded Lipschitz domain in arbitrary dimension, the reconstructed jump set of a bounded-variation function lies in the data jump set of a bounded-variation function up to a surface-null set. The jump-amplitude inequality for total variation denoising proves this: outside , the two BV traces on a hypersurface of agree, so forces . Surviving jumps cannot be stronger than the corresponding data jumps and must have the same orientation. Existing jumps may disappear.
The proof uses scalar total variation splitting under clipping, residual-preserving clipping of an ROF minimizer, total variation under opposite smooth flows and the BV jump-product limit with one bounded factor. It requires neither bounded data nor bounded output. The bounded-forcing geometric proof through noncontact of ROF level boundaries remains an alternative for bounded images; it is not used to infer regularity under unbounded forcing.
The conjugate of an infimal convolution is the sum of the conjugates:
Here , and , the indicator functional of the unit infinity-norm ball. Thus
The infimal convolution is finite convex and continuous, so the Fenchel-Moreau theorem applies without a closure defect. By equality in the Fenchel–Young inequality and the subdifferential sum rule,
This is precisely the variational characterization of projecting onto the cube. Consequently
For the primal split, and . These directly minimize the two scalar terms. The Huber loss is continuously differentiable, including at , but its second derivative changes there. The one-dimensional sketch shows a quadratic center joined tangentially to linear tails:
Figure 1.
The scalar Huber function with quadratic center and linear tails joined at minus one and one
. Details.
Applied to a discrete gradient, the Huber gradient regularizer penalizes small slopes quadratically and large slopes linearly. Compared with pure squared-gradient smoothing it preserves large edges better; compared with pure total variation denoising it encourages small smooth variations and reduces the strong preference for piecewise-constant plateaus. It can therefore be useful for denoising signals or images containing both smooth regions and sharp transitions. It still penalizes edges and can bias their amplitude, and it does not guarantee complete elimination of staircasing in total variation denoising. The unit threshold must be scaled appropriately for data units and grid spacing.
A one-dimensional Sobolev representative is absolutely continuous. For , the fundamental theorem of calculus and Holder inequality give
Thus has a representative in . The qualification about representatives matters because a Sobolev space element is an almost-everywhere equivalence class.
In two dimensions, the Sobolev fundamental theorem of calculus on lines and Fubini's theorem imply that almost every horizontal and vertical slice belongs to and has this one-dimensional Hölder continuity. The slice seminorm depends on the slice; this does not give one uniform pointwise estimate on the square. For , Morrey's inequality additionally gives a globally Hölder continuous representative of exponent . For , global continuity need not hold. For example, with a smooth cutoff around an interior point, lies in when , but is unbounded. At , the cutoff version of is unbounded while its gradient has finite squared integral, since
These examples distinguish Sobolev slicing and planar continuity from a false two-dimensional application of the interval exponent.
Put . A BV space is a function whose distributional derivative is a finite vector-valued Radon measure. Equivalently its total variation seminorm is finite:
The BV space has norm . For , integration by parts against the compactly supported field gives . Conversely the measurable choice on nonzero gradients attains the pointwise bound. Approximating this bounded field by smooth fields, using interior cutoffs and the finite measure , justifies the supremum and gives
It is a norm of the derivative measure, rather than a pointwise derivative at jump discontinuities.
There is a genuine mismatch in the printed definition of the next functional. Its constraints on and are independent. Hence its stated supremum, denoted , separates as
The scalar supremum is , by cutoffs approaching one, and the vector supremum is the variation. For an affine image signal with , this gives , whereas the displayed square-root area would give . The intended relaxed graph-area functional instead uses the coupled pointwise constraint , giving
where is the singular part of . Both readings have a minimizer, but their equations are different.
Here is the direct method in the calculus of variations for either reading. Let be the literal or the corrected , and define the energy on , assigning infinity elsewhere. A minimizing sequence has bounded energy by comparison with . Both , so its variation is bounded, and the fidelity bounds , hence also and . By bounded-variation compactness, a subsequence converges strongly in to , and after another subsequence almost everywhere. Fatou's lemma proves
The regularizer is a supremum of affine functionals continuous in , since the test-field divergence is bounded. It is therefore lower semicontinuous. Combining the two lower bounds proves existence of a minimizer. In fact the convex regularizer and the strictly convex squared fidelity make the minimizer unique up to null sets. This does not assert that the minimizer must belong to .
For the intended graph area, conditionally assume that the minimizer is in . For , differentiate at . The derivative of the integrand is bounded by , so dominated convergence applies. The weak equation is
that is,
This is the graph-area Euler-Lagrange equation. Compactly supported variations impose no boundary condition in this statement.
For the literal printed supremum, the constant drops out and one obtains total variation denoising. Its total variation calibration form is
The distributional equation means . In particular wherever the gradient is nonzero; writing this quotient without handling zero gradients would be incomplete. Formally the one-sided derivative of is
Minimality in the directions and bounds the remaining linear functional by the second integral. The Hahn-Banach theorem extends it on that zero-gradient set to a bounded vector field of magnitude at most one, furnishing and the displayed weak equation. Thus the literal definition has a nonsmooth subgradient equation, not the square-root equation above.
Either essay option suffices; both are developed here to make the two mathematical constructions available.
Diffusion for images. Model grey level as , initially , and use a Neumann boundary condition to avoid flux across an image boundary. The linear heat equation smooths the data. On its solution is convolution with the heat kernel, . Equivalently each Fourier mode is multiplied by , suppressing high frequencies and noise. With no flux, the mean is conserved and
The drawback is that sharp edges also contain high frequencies: a step becomes a transition of width comparable to . Running the heat equation backwards attempts sharpening but amplifies modes by and is ill-posed.
The Perona-Malik equation instead uses a decreasing diffusivity,
Small gradients are smoothed strongly and large ones less strongly. If and is a unit tangent to a level curve, then away from zero gradient,
The derivative of the flux, rather than just , controls forward parabolicity. Here becomes negative for : smoothing remains tangential but the normal direction can sharpen. This formal edge enhancement comes with forward-backward ill-posedness, so existence and stability of the unregularized continuum equation must not be presumed. One regularization uses as a smoothed edge detector while keeping the flux proportional to . For fixed positive , the coefficient is controlled by the smoothed data; under suitable bounds it stays positive and gives a regularized forward equation. It preserves edges through reduced cross-edge transport, without the same local backward-diffusion calculation.
Diffusion from a gradient energy connects these equations with variational regularization. If , its formal gradient flow is . Linear diffusion corresponds to . The displayed Perona-Malik equation corresponds to , which is nonconvex in the gradient for large . A convex alternative is total variation flow, with , interpreted through a subgradient at zero gradient. Adding squared data fidelity gives the formal evolution , whose equilibrium is the unique total variation denoising minimizer. Convex TV preserves sharp interfaces more effectively than the heat energy, but it may produce piecewise constant plateaux, known as staircasing in total variation denoising. A stopping time or fidelity weight controls the smoothing scale. Linear diffusion is stable but blurs edges; nonlinear diffusion must balance edge selectivity with parabolicity and regularization.
Wavelets on an interval. Simply restricting a whole-line orthonormal wavelet to destroys its orthogonality and generally its vanishing moments. Periodizing the basis restores orthogonality on the circle, but treats the two endpoints as neighbors. This is suitable for periodic data and can create an artificial endpoint jump for nonperiodic data.
A localized interval-adapted wavelet basis instead uses unchanged interior functions and finitely many special boundary wavelets at each endpoint. Start with a sufficiently regular compact support orthonormal Daubechies wavelet of order at least and choose a coarse level at which left and right boundary supports are disjoint. At each boundary, take appropriate finite combinations of the scaling functions that meet the endpoint, restricted to the interval. Choose these combinations to reproduce polynomials of degrees , remove dependencies, and orthonormalize the finite boundary Gram matrix. The choices must be compatible with refinement so that the resulting finite-dimensional spaces are nested; independent arbitrary orthonormalizations would not ensure this. Interior functions retain their whole-line filters, while the boundary functions use finite boundary refinement matrices.
For each level, choose an orthonormal basis of the orthogonal complement . It consists of interior wavelets and a bounded number of left and right boundary wavelets. Since the polynomial restrictions of degree less than belong to , every member of has vanishing moments. The compatible local boundary construction retains support diameter and the regularity of the interior construction. Boundary modification affects only finitely many functions at each level, so increasing resolution still makes the union dense in . Consequently, for a fixed coarse level ,
The coarse scaling functions together with all these wavelets form an orthonormal basis. This construction is the Cohen-Daubechies-Vial interval wavelet construction. It preserves localization, polynomial cancellation and stable coefficient extraction without imposing periodic or zero boundary data. The finite boundary refinement matrices also permit a fast transform; a mere restriction followed by one unrelated Gram-Schmidt process at each scale does not establish all these properties.
For , discrete total variation denoising is the proximal operator of the support function of . The Moreau decomposition gives the displayed projection residual. It is generally not itself a metric projection onto a closed convex set: such a projection is idempotent, but TV denoising shrinks a sufficiently large two-level jump again when reapplied.
If minimizes scalar total variation denoising with , set , and . The scalar total variation splitting under clipping gives . Compare with and use ; cancelling the tail shows that minimizes the same model for . It is bounded while may be unbounded, and exactly. This reduction concerns the actual minimizer, rather than convergence of minimizers for truncated data.
Total variation calibration Created 2026-10-06 Updated 2026-10-07
For an absolutely one-homogeneous functional on a real Hilbert space, a subgradient at is characterized by for every and . A bounded vector field with and proves the inequality through the dual definition, provided cutoff approximation is valid in the ambient space. Equality is called a calibration. It certifies a global minimizer of total variation denoising, rather than only a minimizer within a chosen ansatz.
Total variation flow Created 2026-10-05 Updated 2026-10-06
Total variation flow is the gradient flow of the total variation seminorm on a domain. Formally it is , but the subgradient formulation handles zero gradients and jumps. Adding quadratic fidelity gives a strictly convex stationary total variation denoising problem.
A variational model balances agreement with observed data against a regularity or geometric penalty. Examples include total variation denoising, the relaxed graph-area functional, and the Mumford–Shah functional. Convex penalties support unique reconstruction, while segmentation energies can have multiple competing partitions.