Variational regularization balances data fidelity against a lower-semicontinuous penalty, for example by minimizing .
Replacing a discrete gradient by a second-difference operator gives the global-norm penalty . Its reconstruction is for . Components in are preserved; affine-image membership of this kernel depends on the boundary stencil. Pixelwise Hessian penalties instead use a product of four-component balls.
For a discrete image signal operator , minimize with one Euclidean norm on the full gradient array. This differs from discrete isotropic total variation, which sums pixelwise Euclidean lengths. The global norm's dual ball is a single ball; its convex projection normalizes the whole vector array.
Let with one global dual ball. Its support function is , and the proximal operator of a support function gives . The removed component is the convex projection, while the reconstructed image signal is its residual. Projected gradient descent on , , converges for .
For positive observations and positive predicted intensities , this is the generalized Kullback–Leibler divergence with observation in the first argument. Its scalar derivative in is and its second derivative is . It differs from the divergence of a reconstructed density from a reference density by which argument is varied. A linear prediction gives derivative through the adjoint operator, on suitable admissible function spaces. This fidelity arises from the negative log likelihood of a Poisson observation model, after removal of terms depending only on observations.
For and a positivity-preserving operator, this is the negative log-likelihood for independent Poisson observations with intensity , up to constants depending only on the data and the unit background. For bounded , its scalar derivatives are and on . It is convex, and strictly convex in the predicted intensity when almost everywhere. On a unit-area domain, the Jensen inequality gives . The shift makes integrable whenever ; no integrability of is needed.
Let be a bounded connected Lipschitz domain, , bounded, and bounded and positivity preserving with . Minimize over nonnegative BV space functions. The logarithmic Jensen inequality bounds and variation on sublevels; mean control for positive imaging operators then bounds the full norm. Bounded-variation compactness gives strong convergence, including nonnegativity. The scalar fidelity has bounded derivative on , so continuity of makes its integral continuous in that limit. Lower semicontinuity of variation proves existence by the direct method in the calculus of variations. If almost everywhere and is injective, strict convexity of the fidelity gives uniqueness. For , zero is the unique minimizer even without injectivity, since zero energy forces both and a constant nonnegative .
On a bounded domain, suppose , , and a bounded positivity-preserving operator satisfies . Every strictly positive has : otherwise for all , and continuity gives . Since whenever , every such has positive energy. The constants have zero variation and energy at most . Their excluded zero limit proves nonattainment. Coercivity and bounded-variation compactness cannot by themselves preserve a nonclosed strict-positivity constraint.
For and , minimizing on gives . The roots have opposite signs, so only the displayed positive root belongs to the effective domain. Strict positivity of the second derivative proves uniqueness. For an integral Poisson data fidelity, the proximal operator separates pointwise under the appropriate integrability assumptions.
This convex function penalizes positive densities using negative entropy, with and infinite value for negative inputs. Its scalar derivative is on . On a bounded domain, restricting to uniformly positive bounded functions gives a simple setting for a Fréchet derivative. Its Bregman distance is the generalized Kullback–Leibler divergence. With fixed total mass, minimizing this negative-entropy expression maximizes the corresponding entropy.
Exact fitting in the small-parameter limit requires data that can be approximated by forward images of elements in the regulariser's effective domain. Membership merely in the operator range is insufficient when an extended-real regulariser imposes a hard constraint.
For a nonnegative regulariser , the optimal objective value is non-decreasing and concave in the positive regularization parameter. If and , comparison with zero makes it finite and a locally Lipschitz function away from parameter zero.
For , choosing global minimizers of and gives and . The decrease in penalty and increase in data misfit satisfy .
For objectives with and positive parameter, suppose nearby-parameter global minimizers have uniformly bounded penalty, stay in a bounded set with convergent subsequences, and and are sequentially lower semicontinuous in the chosen topology. Their optimality inequalities and lower semicontinuity show that every subsequential limit minimizes the limiting objective. Uniqueness makes the regularized solution continuous in the parameter. Existence alone does not make an arbitrary selection among multiple global minimizers continuous.
For a bounded linear operator between Hilbert spaces, minimize , with . The objective is coercive and weakly lower semicontinuous, and its strictly convex norm penalty gives a unique minimizer. Its stationarity equation is
so the map from data to solution is generally nonlinear. For admissible fixed , comparison with bounds the minimizer's norm by and makes its squared residual converge to the minimum least-squares residual. Every weak cluster point is therefore a least-squares solution of norm at most , hence equals the minimum-norm least-squares solution. Weak lower semicontinuity then forces convergence of norms, and the Radon-Riesz theorem gives strong convergence. This supplies a nonlinear regularization of an inverse problem.
For completeness, the fixed- data-to-solution map is continuous. For , setting and gives
Subtracting the stationarity equations for data and pairing with therefore gives . Thus
which proves continuity directly.
For an exact equation and a penalty , a -minimizing solution is a feasible point such that
Given , the residual method minimizes a penalty subject to . Every exact solution is feasible, so a reconstruction has penalty no larger than that of any J-minimizing solution.
Suppose is nonnegative and sequentially lower semicontinuous, and its sublevel sets are strongly sequentially compact. For a solvable exact equation , every sequence of residual-method minimizers with has a strongly convergent subsequence, and every limit is a J-minimizing solution. Indeed, comparison with an exact penalty minimizer bounds all reconstructions in one compact sublevel set; the residual bound gives . Continuity of and lower semicontinuity of identify each subsequential limit as an exact minimizer. Thus the distance to a set of exact penalty minimizers tends to zero. Uniqueness of the exact minimizer upgrades this to full strong convergence.
Uniqueness cannot be omitted: for , , and on , the sublevel sets are compact intervals but the minimizers do not converge.
For , the total variation seminorm is
It extends the integral of the magnitude of the gradient to nonsmooth functions.
For the local flow of a smooth compactly supported vector field and any scalar BV space function , the change of variables formula and polar decomposition of a vector measure give
The two cofactor matrices are uniformly. On , the linear terms in their Euclidean norm expansions cancel. Integration bounds the remainder by . The identity includes all components of the decomposition of a BV derivative; it does not require smoothness of or its jump interfaces.
For an absolutely one-homogeneous functional on a real Hilbert space, a subgradient at is characterized by for every and . A bounded vector field with and proves the inequality through the dual definition, provided cutoff approximation is valid in the ambient space. Equality is called a calibration. It certifies a global minimizer of total variation denoising, rather than only a minimizer within a chosen ansatz.
Total variation flow is the gradient flow of the total variation seminorm on a domain. Formally it is , but the subgradient formulation handles zero gradients and jumps. Adding quadratic fidelity gives a strictly convex stationary total variation denoising problem.
For on a bounded domain, total variation denoising has a unique minimizer. A bounded minimizing sequence has a weakly convergent subsequence; variation is a supremum of weakly continuous test-function pairings and the fidelity has weak lower semicontinuity. The strictly convex fidelity proves uniqueness. Bounded-variation contraction under clipping proves that data range bounds pass to the minimizer.
This finite-image convex optimization model combines robust L1 norm fidelity with discrete isotropic total variation and pixel-range constraints. An exact second-order cone program uses two orthant fidelity slacks per pixel, two box slacks per pixel and a three-dimensional Lorentz cone for each gradient magnitude. The product canonical barrier has parameter for pixels.
For scalar total variation denoising with on a bounded Lipschitz domain in arbitrary dimension, the inequality holds with common oriented BV traces on a hypersurface. It says that every surviving jump has the same direction as its data jump and no larger amplitude. Reversing the normal changes both differences and preserves the inequality.
Use residual-preserving clipping of an ROF minimizer and the jump-amplitude inequality for a bounded ROF minimizer. At each finite jump, choose an integer clipping level above both output traces. The clipped function has those same traces, and its residual-adjusted data have the same traces as . Taking a countable union over the integer clipping levels proves the result. This gives the no-new-jumps property of total variation denoising under the full assumptions, without asserting regularity of unbounded-forcing perimeter minimizers.
For scalar total variation denoising with on a bounded Lipschitz domain in arbitrary dimension, the reconstructed jump set of a bounded-variation function lies in the data jump set of a bounded-variation function up to a surface-null set. The jump-amplitude inequality for total variation denoising proves this: outside , the two BV traces on a hypersurface of agree, so forces . Surviving jumps cannot be stronger than the corresponding data jumps and must have the same orientation. Existing jumps may disappear.
The proof uses scalar total variation splitting under clipping, residual-preserving clipping of an ROF minimizer, total variation under opposite smooth flows and the BV jump-product limit with one bounded factor. It requires neither bounded data nor bounded output. The bounded-forcing geometric proof through noncontact of ROF level boundaries remains an alternative for bounded images; it is not used to infer regularity under unbounded forcing.
Assume minimizes scalar total variation denoising for . The data may be unbounded. For the local flow of , use as two competitors. The total variation under opposite smooth flows and convexity of the total variation seminorm bound the sum of regularizer changes by . Minimality and the opposite-flow fidelity identity for quadratic data, evaluated using the BV jump-product limit with one bounded factor, imply
Let . The integrands define finite signed Radon measures, since is bounded and the jump variation of is finite. Arbitrary nonnegative smooth make their densities nonnegative. Testing every coordinate direction removes the factor and proves the stated inequality.
If minimizes scalar total variation denoising with , set , and . The scalar total variation splitting under clipping gives . Compare with and use ; cancelling the tail shows that minimizes the same model for . It is bounded while may be unbounded, and exactly. This reduction concerns the actual minimizer, rather than convergence of minimizers for truncated data.
The squared-error term is a strictly convex cost measuring agreement with data.
Let and on a bounded domain, , and for a smooth compactly supported local flow. The displayed formula is exact to an remainder, and need not be bounded. Writing , its cross-term identity is
The remainder is because and weighted convergence follows from
First let , then . The mass change of under opposite flows is . Combined with the BV jump-product limit with one bounded factor, this evaluates the jump contribution without a bounded fidelity derivative.
The scalar ROF denoising minimizer has perimeter-plus-forcing minimizing superlevel sets at almost every height. Conversely any finite-energy function with that property minimizes the full energy. The signed layer-cake identity for quadratic fidelity and coarea formula for BV functions prove sufficiency. To prove necessity, construct nested minimizing sets using comparison of perimeter minimizers with ordered forcing, reconstruct a function from rational levels, clip to establish energy bounds, and use uniqueness from strict convexity of the squared fidelity.
For bounded BV space data and , nested ROF level-set formulation minimizing sets cannot share an interface of positive surface measure away from data jumps. On regular graph patches, upward and downward first variations use the BV traces on a hypersurface. At contacts outside the forcing BV trace on a hypersurface agrees, whereas the two levels differ by . Graph regularity and contact differentiation give the contradiction. Bounded forcing is a hypothesis of this argument; arbitrary unbounded data are not covered by this statement.
For positive , integrate from zero to ; for negative , reverse the integral from to zero. This proves the identity without a positivity restriction on the data. For , the absolute integral is bounded by , so Fubini's theorem applies. The zero-function baseline removes the divergence from the negative-height tail.
For finite convex total variation and a positive squared-error budget, the Slater condition supplies a multiplier such that every constrained minimizer also minimizes . Conversely, a minimizer of that penalized objective with minimizes total variation under the budget equal to its own squared error. Complementary slackness proves the first implication; a comparison of objective values proves the second. This does not assert uniqueness of the multiplier or equality of all minimizer sets when .
The graph total variation measures absolute variation of a vertex signal across edges. It is independent of the orientation used for the oriented incidence matrix. It vanishes exactly on signals constant on each connected component of a graph. A graph total variation denoising estimator combines this penalty with squared error, favouring signals that are piecewise constant on connected regions.
Graph total variation denoising is a penalized least-squares estimator for noisy vertex signals on a graph. The squared loss is strictly convex, so the fitted signal is unique. Its basic inequality for a penalized least-squares estimator separates a noise inner product from the change in penalty. The incidence pseudoinverse decomposition controls the nonconstant noise through the geometry of the graph.
For data on , the minimizer of is the displayed amplitude shrinkage, including extinction at . The total variation calibration uses inside the disk and outside. Its continuous normal component creates no boundary measure, and . This subgradient certifies the positive branch; scaling it down certifies the zero branch. The quadratic fidelity is strictly convex, ensuring uniqueness.
Staircasing is the formation of approximately constant plateaux in reconstructed data, even when the original data vary smoothly. The linear growth of the total variation seminorm on a domain favors sparse spatial gradients, so preserving jumps can come at the cost of flattening gradual transitions.
With zero forward differences at the grid boundary, discrete isotropic total variation is the sum of the Euclidean lengths of the two-component forward gradients. Its dual constraint is the product of unit Euclidean balls, and minimizing over that product yields . The exact difference adjoint operator is essential. A dual proximal gradient method projects pointwise onto unit balls; is safe on an unscaled square grid.
For , discrete total variation denoising is the proximal operator of the support function of . The Moreau decomposition gives the displayed projection residual. It is generally not itself a metric projection onto a closed convex set: such a projection is idempotent, but TV denoising shrinks a sufficiently large two-level jump again when reapplied.
Minimize over using
The pointwise Euclidean projection onto a convex set sends a block to . The gradient of has Lipschitz constant , so finite-dimensional projected gradient descent converges for . On an unscaled square grid with , is safe. Reconstruct ; unused dual directions may make the minimizing nonunique while the primal minimizer is unique.
For strictly inside a one-dimensional domain, the indicator has distributional derivative , hence . Directly from the test-function definition, , and two disjoint normalized smooth bump functions attain the bound. Values at the endpoints themselves do not change the function.
A function has bounded variation when . The space is a Banach space with norm .
A Cauchy sequence in the BV space converges in to . For fixed sufficiently large , lower semicontinuity gives . The norm of the same difference converges, so the small full-norm Cauchy bound passes to . The triangle inequality then puts in the BV space and proves convergence in its full norm. This argument turns completeness of and lower semicontinuity of variation into completeness of the combined norm.
For a BV space function , almost every restriction to a line parallel to has bounded variation on the corresponding domain slice. Directional derivative variation disintegrates as . Slice jump values agree with the appropriate oriented BV traces on a hypersurface for almost every crossing of a rectifiable jump surface. Integrating slice jump sums produces a surface integral with projection factor . Uniform essential bounds on the slices are not asserted for an unbounded function.
Let , and , where is the local flow of with nonnegative . The formula uses common oriented BV traces on a hypersurface; the trace difference of is zero almost everywhere on . It also holds for both negative-time increments with denominator positive .
The BV slicing theorem reduces the calculation to one dimension. With a right-continuous representative of and , Fubini's theorem yields
The inner factor tends to and is bounded in absolute value by . Dominated convergence against leaves only its measure atoms at the countable slice jumps of . That same bound times permits integration over the transverse coordinates. No essential bound on is used, even if its slice values grow without bound. The formula is useful for opposite-flow fidelity identity for quadratic data with unbounded data and a bounded comparison function.
A BV space function has two one-sided approximate mean BV traces on a hypersurface at almost every point of an oriented countably rectifiable hypersurface, with respect to Hausdorff measure. They agree outside its approximate discontinuity set. At an approximate jump point, they are the jump values, up to the choice of orientation.
A BV space function is approximately differentiable at almost every point with respect to Lebesgue measure. Its approximate gradient is the density of the absolutely continuous part of its distributional derivative. This does not imply membership in a Sobolev space.
For a BV space function, this is the set where no finite approximate mean limit of a function exists. Its difference from the jump set of a bounded-variation function has zero -dimensional Hausdorff measure.
Both functions represent the same equivalence class. Fubini's theorem shows that the interval-mass function has derivative , so its difference from is constant. Continuity of a finite measure gives left continuity for and right continuity for . Their opposite one-sided limits differ by the measure atom . There are only countably many nonzero measure atoms, since every set of measure atoms above a fixed magnitude threshold is finite.
An approximate mean limit of a function is a value satisfying the displayed condition. Functions in the BV space have such finite limits outside an approximate discontinuity set up to negligible sets in the appropriate measure. Their approximate jump points instead have two distinct half-ball limits.
A scalar function in the BV space has an approximate jump at a point when its mean on each of two half-balls approaches a different finite value. The half-balls are determined by a unit normal . Reversing the normal exchanges the two BV traces on a hypersurface. Their collection is the jump set of a BV function.
For a scalar function in the BV space, derivative variation is the integral of the relative perimeter measures of its superlevel sets. The formula holds on every Borel subset of the domain, not just for total mass. It converts the continuous ROF denoising problem into linked minimization problems for finite-perimeter sets.
The functional is bounded in the uniform norm exactly when belongs to the BV space. Extend it from compactly supported smooth tests to , then apply the Riesz-Markov-Kakutani representation theorem to obtain the unique finite vector Radon measure . Its dual norm is the defining variation supremum. This representation should be distinguished from the deeper rectifiability results used in the decomposition of a BV derivative.
The Lebesgue decomposition theorem separates the absolutely continuous part from the singular part. BV fine structure then splits the latter into the jump part of a BV derivative and the Cantor part of a BV derivative. The density of the absolutely continuous part is the almost-everywhere approximate gradient. These three mutually singular components distinguish smooth variation, surface discontinuities and diffuse singular variation.
This derivative component is carried by the jump set of a BV function. Swapping the two BV traces on a hypersurface and reversing the normal leaves it unchanged. In one dimension it consists of the point measure atoms, each weighted by the difference between the right and left limits.
For a smooth function, integrate its directional derivative along each segment of length and then integrate in space. This gives the displayed bound with . Smooth BV approximation and sequential lower semicontinuity give the same inequality for general functions in the BV space. Averaging it over a mollifier proves the BV mollification error estimate.
For a nonnegative normalized mollifier supported in the radius- ball, integrate the BV translation estimate with weight . The full-space derivative variation controls the full-space error. Replacing it by variation on a smaller domain is invalid without a support condition: a nonconstant bump outside that domain has zero derivative measure inside but a nonzero mollification error.
For a bounded Lipschitz domain, functions can be extended with the displayed bound and common compact support. Reflect across local Lipschitz boundary graphs, combine the reflected functions with a partition of unity, and multiply by a fixed cutoff function. Lipschitz coordinate changes control derivative measures; the product rule bounds cutoff function terms by the norm. Zero extension is also possible with an estimate for BV traces on a hypersurface, but its boundary jump must be included in the variation.
Convergence in the displayed sense combines strong function convergence with weak-star convergence of derivative vector measures against tests. Strong convergence and a uniform variation bound imply the derivative convergence by integration by parts and uniform test-function approximation. Conversely the Uniform boundedness principle bounds the derivative measures of a convergent sequence.
Strict convergence combines strong convergence in with convergence of the total variation seminorm. It implies weak-star convergence in BV but does not make jump sets stable: mollifications of an interior step can converge strictly to the step while every approximant has an empty jump set of a bounded-variation function.
A measurable set has finite perimeter in when belongs to the BV space. Its relative perimeter is . Relative perimeter excludes the exterior image signal boundary and measures the interior interface in Caccioppoli partitions.
The perimeter of a measurable set relative to an open domain is the total variation seminorm of its indicator function there. For a smooth region it equals the Hausdorff measure of the boundary lying inside the domain. Global perimeter uses the entire space as the domain; an internal interface shared by two regions appears in both relative perimeters and must be counted only once in a segmentation energy.
Here the sets of finite perimeter differ only compactly inside . A minimizing set with bounded volume forcing satisfies this inequality. Interior regularity theorems give graph patches outside a singular set negligible for surface Hausdorff measure; bounded forcing allows the graph estimates used in the noncontact of ROF level boundaries.
The total variation seminorm of the indicator function within an open set counts only its interior interface. The perimeter of a zero extension may add a boundary contribution.
The BV lattice inequality applied to two indicator functions gives the perimeter inequality. For smooth approximations, minima and maxima partition the two gradients; sequential lower semicontinuity passes the estimate to BV. It prevents a crossing of minimizers with strictly ordered set forcing.
Suppose minimizes and minimizes . Compare them with their intersection and union. Adding their optimality inequalities and using submodularity of relative perimeter gives . Strict ordering forces that set to be null. Applied to , this yields nested ROF denoising superlevel sets.
A Caccioppoli partition is a countable measurable partition, up to null sets, into sets of finite perimeter with finite sum of relative perimeters. Its interior interfaces are counted twice by that sum. It represents regions of a piecewise constant image signal in the piecewise-constant Mumford–Shah problem.
The derivative measure of a BV space function decomposes into its absolutely continuous, jump and Cantor parts. The Cantor part of a bounded-variation derivative is singular but not a jump measure on a rectifiable hypersurface. The special bounded-variation space excludes it; finite-length image signal interfaces alone cannot describe it.
The jump set consists of points where a BV space function has distinct one-sided approximate values across an approximate normal. In the plane its derivative contribution is . The Mumford–Shah functional penalizes its length rather than the jump amplitude.
A BV space function is special when its derivative has no Cantor part of a bounded-variation derivative: . The remaining singular part is supported on the jump set of a bounded-variation function. This space accommodates sharp interfaces and is the natural setting for the Mumford–Shah functional.
For uniformly bounded values, an gradient bound with , and bounded -dimensional jump measure, a sequence in the SBV space admits an -convergent subsequence whose limit remains special. Gradients converge weakly in , and jump measure is lower semicontinuous. These hypotheses prevent diffuse singular derivatives from replacing the controlled interfaces in a minimizing limit.
For a BV space function with , relaxed graph area is . Its dual supremum uses the coupled constraint in the pairing . It is convex and lower semicontinuous in . Independent bounds on the two test fields define a different functional.
For an assumed minimizer of , compactly supported variations give in distributions. If the regularizer is instead the total variation seminorm, a bounded calibration field replaces the quotient and handles zero gradients.
The independent constraints and separate the dual supremum into . They do not define square-root graph area. For the box-constrained value is , while the relaxed graph-area functional is .
On a bounded Lipschitz domain, a sequence with bounded norms and bounded total variation seminorm has a subsequence converging strongly in . The limit is in the BV space, and its variation does not exceed the limit inferior. This supplies the compactness step of the direct method in the calculus of variations for linearly growing gradient energies.
In the formulation of total variation denoising on the entire plane, one may allow finite distributional total variation seminorm on a domain without requiring global membership. Its extended penalty is a supremum of continuous test-function pairings and hence is sequentially lower semicontinuous. This domain can be larger than , since the usual bounded-variation space includes an condition.
For , the radial function belongs to and has finite distributional total variation seminorm on a domain, but is not in . Cutting it off outside radius gives bounded-variation space functions tending to in , with variation tending to that of : the added jump costs . Thus the penalty equal to TV on and infinity elsewhere is not sequentially lower semicontinuous in . The closed homogeneous bounded-variation space extension avoids this domain issue.
The distributional derivative of this indicator function is on the vertical segment , so its total variation seminorm on a domain is one. This is singular with respect to planar Lebesgue measure, whereas Sobolev space weak derivatives in have integrable densities. Its bounded-variation space norm is .
For and , and . This is the contraction property of a one-Lipschitz scalar composition, obtainable by smooth approximation and sequential lower semicontinuity. It proves range preservation for total variation denoising when the data lie in .
For a scalar BV space function, clipping to partitions its coarea formula for BV functions into middle and tail levels. The clipped function has the original superlevel sets at heights in . The positive tail levels of correspond to original heights above , and its negative tail levels to heights below . Thus their total variation seminorms add exactly. This is stronger than the triangle inequality and is specific to scalar monotone clipping. It supports residual-preserving clipping of an ROF minimizer.
On a bounded domain of positive measure, the constant functions satisfy while . Thus the total variation seminorm on a domain is neither coercive in the norm nor strictly convex. Additional control of the mean can remove this obstruction; the Poincaré inequality for total variation supplies the needed bound on suitable connected domains.
The zero-mean bounded-variation space is
On a bounded connected Lipschitz domain, removing the constant nullspace makes total variation coercive on this subspace by the Poincaré inequality for total variation.
On a bounded connected Lipschitz domain,
It reduces to on .
For a set , its extended-real indicator functional is zero on and outside . It converts minimization subject to into unconstrained minimization after adding the indicator to the objective.
A -minimizing exact solution satisfies the source condition when some obeys
It connects a penalty subgradient to the range of the adjoint forward operator.
This stronger source condition in variational regularization requires a subgradient at . For each it is equivalent to making minimize for artificial input . The subgradient optimality condition proves both implications. The source vector may be zero: and satisfy the condition but admit no nonzero source vector.
Let be a least-squares solution and . For a minimizer of , expand the objective about . The normal equation for a linear inverse problem removes the data-residual cross term, while the Bregman distance definition gives
Compare the minimizer with , where the square vanishes, and divide by . The bound is informative when that comparator has finite penalty.
If and , then is a J-minimizing solution. For every other exact solution , the subgradient inequality gives . This is a certificate of global optimality supplied by the range of the adjoint operator.
The range condition asks whether a prescribed exact solution is also a minimizer of a penalized problem with suitably chosen artificial data. The subgradient optimality condition makes it equivalent to a source subgradient lying in the range of the adjoint forward operator.
For a convex functional and , the Bregman divergence is
It is nonnegative but need not be symmetric or satisfy the triangle inequality.
Starting with and , update . The optimality condition makes . The iteration replaces a fixed penalty by its Bregman distance from the preceding iterate and accumulates residual information in the dual variable. The first update uses .
For a generalized singular vector, exact data , and fixed , a compatible branch of Bregman iteration has and the displayed . Verify these formulas with the subgradient characterization of an absolutely one-homogeneous functional; before activation the dual coefficient remains at most , and after activation it is . The branch reaches at . Every minimizer branch has the same predicted data, since the quadratic data fidelity is strictly convex in . Exact recovery of this particular vector for arbitrary branch choices needs uniqueness, for example injectivity of . For and , the second coordinate of every minimizer is arbitrary.
For and , add the two Bregman distances to get . The choice of subgradients matters. This is generally not a metric: it need not separate points or satisfy a triangle inequality.
Let be a bounded linear operator from a real Banach space to a real Hilbert space, let be a proper lower-semicontinuous convex function, and let and . For an existing minimizer of and a source condition in variational regularization , let and . Its optimality subgradient is . Then . The displayed estimate follows from .
For , zero Bregman distance means that equals the supporting affine function . If is strictly convex, two distinct contact points are impossible: convexity along their segment would be strict, while the subgradient inequality supplies the opposite bound. Thus zero distance then implies . Without strict convexity, , , gives zero distance for every . These are all on the same supporting face.
An exact penalty method uses a nonsquared residual such as . Under a source condition it can recover an exact constrained minimizer for every sufficiently small fixed positive .
Suppose and . For , the subgradient inequality and dual pairing bound give
Thus forces every minimizer to solve exactly. Comparison of penalties then shows it is a J-minimizing solution, and . The conclusion also holds for all when . One-homogeneity is not needed for this argument.

Articles by others on the same topic (0)

There are currently no matching articles.