If a good rate function has unique zero mu, every closed set missing mu has strictly positive infimum rate, possibly infinity. Otherwise a sequence of rates tending to zero lies eventually in the compact unit sublevel set; a subsequence converges to a point of the closed set, and lower semicontinuity makes that point another zero. Compactness also ensures existence of a zero whenever the infimum is zero.
A Cauchy sequence in the BV space converges in to . For fixed sufficiently large , lower semicontinuity gives . The norm of the same difference converges, so the small full-norm Cauchy bound passes to . The triangle inequality then puts in the BV space and proves convergence in its full norm. This argument turns completeness of and lower semicontinuity of variation into completeness of the combined norm.
If satisfies a large deviation principle in with good rate function and is a continuous map, then has the same large-deviation speed and good rate function
The preimages of open and closed sets give the two large deviation principle inequalities. The identity follows from compactness and lower semicontinuity by taking minimizing sequences in the fibres; hence is good.
Let be a bounded connected Lipschitz domain, , bounded, and bounded and positivity preserving with . Minimize over nonnegative BV space functions. The logarithmic Jensen inequality bounds and variation on sublevels; mean control for positive imaging operators then bounds the full norm. Bounded-variation compactness gives strong convergence, including nonnegativity. The scalar fidelity has bounded derivative on , so continuity of makes its integral continuous in that limit. Lower semicontinuity of variation proves existence by the direct method in the calculus of variations. If almost everywhere and is injective, strict convexity of the fidelity gives uniqueness. For , zero is the unique minimizer even without injectivity, since zero energy forces both and a constant nonnegative .
Exponential equivalence 2026-10-14
Coupled random elements in a metric space are exponentially equivalent at large-deviation speed if for every
If satisfies a large deviation principle with a good rate function , then so does , with the same speed and rate function. For the upper bound, is contained in , where is the closed -neighborhood. Goodness gives as : otherwise bounded-rate almost minimizers have a convergent subsequence contradicting closedness and lower semicontinuity. For an open-set lower bound, choose a ball about any with a slightly larger ball still in , subtract the superexponentially small error from the probability that belongs to the smaller ball, and shrink the ball. No independence assumption is required.
Suppose a weak large deviation principle with rate function holds on a Hausdorff space, at speed , and the random elements are exponentially tight. For a finite , choose a compact set whose complement has upper exponential rate strictly below , with . The open-set lower bound on implies , so . Lower semicontinuity makes this sublevel set closed, hence compact. For any closed set , split its probability between the compact and . The upper exponential rate is at most . Letting proves the full large deviation principle with a good rate function.
Mumford–Shah functional Created 2026-10-06 Updated 2026-10-07
The energy balances data fidelity, within-region smoothness and image edge length. In its relaxed SBV space formulation the image edge set is . Clipping to the bounded data range, the SBV compactness theorem and lower semicontinuity prove existence; the full segmentation problem is not strictly convex.
The contraction principle for large deviations says that if has a large deviation principle in with good rate function , and is a continuous map between Hausdorff spaces, then has the same large-deviation speed and good rate function
For an open set , its inverse image is open, so the input lower bound gives
For a closed set , its inverse image is closed, giving the corresponding upper bound with .
It remains to prove goodness, including the endpoint issue in the infimum. Each fibre is closed. If , compact sublevel sets and lower semicontinuity make attain its infimum on that fibre: intersect it with the compact set and use the closed nested sublevels tending down to . Hence for each finite ,
The right-hand side is compact, being a continuous image of a compact set, and is closed because the target is Hausdorff. Thus is lower semicontinuous and good, completing the proof.
The contraction principle for large deviations states that if random elements in a space satisfy a large deviation principle with speed and good rate function , and is continuous, then satisfies a large deviation principle at the same speed with
For example, take to be Polish spaces. The rate function is good: its finite sublevel sets are the continuous images of compact sublevel sets. Compactness and lower semicontinuity ensure that a finite fibre infimum relevant to such a sublevel set is attained. The probability bounds follow by taking preimages of open and closed sets.
Fix a finite and choose . By exponential tightness, choose a compact set with outside probability having upper exponential rate strictly below . A compact set in a Hausdorff space is closed, so its complement is an open set. The lower bound of the weak large deviation principle gives
Consequently , and . Lower semicontinuity makes this sublevel set closed in , hence a closed subset of a compact set. Thus it is compact. Every finite sublevel set is compact, so is a good rate function.
Write and . Then . The large deviation principle on the whole space forces ; compact sublevel sets and lower semicontinuity make that infimum attained. The unique possible zero is therefore mu, and .
If a closed set C contains mu, its new infimum rate is zero and the claimed upper bound follows from probabilities being at most one. If it excludes mu, then , possibly infinite: otherwise a sequence of rates tending to zero would have a convergent subsequence in a compact sublevel set, with limit in C and zero rate, contradicting uniqueness. This is the fact that a good rate function is separated from zero away from its minimizer.
Choose any . The original upper bound gives for all sufficiently large n. Thus
Together these cases prove the closed-set upper bound at the slower speed, with rate zero only at mu. Its finite sublevels are the compact singleton , so it is a good rate function.
Let , and first suppose . For the infinite-horizon contraction, use the usual sublinear path space for fluid queues,
We interpret the supplied path-space large deviation principle in this norm, or in a topology with the same workload-continuity property. The paper does not specify its norm explicitly; mere convergence on compact time intervals would not justify an infinite-horizon contraction.
Define the queue workload functional
It is finite and nonnegative on the sublinear path space for fluid queues. Here is the required continuity argument. Fix and choose so that for . If , then for ,
The corresponding expression for is also negative there, whereas at zero both are zero. Each supremum can therefore be restricted to , giving
Thus is a continuous map; this proof also shows why the negative drift is essential.
Substituting into the queue workload gives
The contraction principle for large deviations says that a continuous image of a family with good rate function has the same large-deviation speed and good rate function obtained by minimizing over each fibre. Consequently
In particular : in the path norm almost surely, so the given large deviation principle and lower semicontinuity give , and . If , the queue workload is identically zero and the rate function is zero at zero and infinite elsewhere. No unspecified variance normalization of the fractional Brownian motion is needed for this variational answer.
Write for the total variation seminorm on a domain. For a locally integrable real function its dual definition is
The bounded-variation space consists of functions with finite , equipped with . In the equivalent distributional derivative description, is a finite vector-valued Radon measure and is its total variation measure.
To establish completeness of the bounded-variation space, let be Cauchy in this norm. Completeness of gives in . Given , choose so that whenever . For fixed , the given lower semicontinuity yields
Since , we obtain . In particular has finite variation; the triangle inequality then puts in the BV space. The same bound proves convergence in the full norm, so this is a Banach space.
For the disk data, put and assume . The exact total variation denoising of a disk is
Here is the positive part. A total variation calibration certifies global optimality, including competitors that are not radial or piecewise constant. Define the bounded vector field
It has . Its normal component is continuous across the circle, so the distributional divergence has no extra boundary measure. Direct differentiation gives . The dual definition implies : for the standard domain one can cut off at radius , with the error bounded by , and then smooth the test field. In the larger homogeneous bounded-variation space, the same error is bounded by . Thus both usual whole-plane formulations give the same certificate.
Use the perimeter identity and . If , then and . Consequently every competitor satisfies
If , replace by . Its norm is still at most one, its divergence is , and equality in the calibration holds at . The identical comparison proves optimality and uniqueness of zero, including the threshold . The only general results used are completeness of , lower semicontinuity of variation, the indicator-perimeter identity, the distributional integration-by-parts/dual variation formula and the quadratic norm identity. For , the unique squared-error minimizer is simply .
Positivity means almost everywhere, since the real logarithm must belong to . A positivity-preserving operator gives . For fixed , the scalar shifted Poisson data fidelity is , with
Composition with the linear operator proves convexity in , and strict convexity holds along pairs whose forward images differ on a set of positive measure. The admissible class itself is convex: the concavity of the logarithm gives , controlling its negative part, while controls its positive part.
Because and , the Jensen inequality gives the requested bound:
The final equality uses nonnegativity and the unit area. Since , this controls the forward-image norm on energy sublevels.
The printed strictly positive problem has no minimizer. This is nonattainment under strict positivity for shifted Poisson fidelity, rather than a failure of the coercivity calculation. Indeed, with and , implies . Also cannot vanish identically for a strictly positive . To see this, let . If , positivity and give . But in and continuity of would imply , contradicting the hypothesis. Thus every admissible has positive fidelity and hence positive total energy.
Conversely, the constants are admissible, have zero total variation, and satisfy
Their logarithms are integrable for each , but the limit is excluded. Therefore
A bounded minimizing sequence and bounded-variation compactness do not repair a nonclosed positivity/logarithm constraint. In particular, a literal existence or uniqueness proof for that domain is impossible.
The natural correction is to minimize over with , omitting the unnecessary condition: the fidelity only contains , which is already integrable. Here is the full existence for nonnegative shifted Poisson regularization argument, also valid for any bounded nonnegative data . Let , , and take a minimizing sequence of energy at most . The displayed bound gives and . Write . The Poincaré inequality for total variation and mean control for positive imaging operators yield
The denominator is nonzero, so the full norm is bounded. Bounded-variation compactness gives in along a subsequence, with . Continuity gives in . On , , so the fidelity converges in the integral; lower semicontinuity of variation completes the direct method in the calculus of variations.
For the actual printed data , the corrected problem has the unique minimizer , even if is not injective. Zero attains energy zero. Any other zero-energy candidate would have both and ; on the connected square, zero variation makes a nonnegative constant, and forces that constant to vanish. For general positive bounded data, an injective is a sufficient uniqueness condition, because its fidelity is strictly convex; injectivity is not a necessary condition in every instance.
In the finite-dimensional interpretation, let . Independent Poisson observations with these intensities have negative log-likelihood . Removing the constant gives precisely the stated fidelity. Thus the model is Poisson counting noise with a unit background intensity, or an approximate version of it for rescaled/continuous grey values. Literal Poisson counts are integers; the constraint is a grey-value normalization, not a literal unscaled count sample.
Let and fix the reference noise budget . Define the convex perturbation function
Positive increases the allowed squared noise level. The feasible epigraph set is convex and closed, so this is a proper lower semicontinuous jointly convex perturbation. Writing the inequality indicator as a supremum over its multiplier gives
The Lagrange dual function is for . In the signed convex conjugate convention of part (a), ; positive gives dual objective because the perturbation can be made arbitrarily large.
The feasible ball is nonempty and compact, so lower semicontinuity of total variation gives a primal minimizer. For , satisfies , providing the Slater condition. Total variation is finite everywhere in the given discretization and hence continuous. Strong duality and dual attainment give a finite optimal . The pair satisfies the Karush-Kuhn-Tucker conditions
Equivalently,
Thus the set of saddle points is nonempty. Compactness handles primal attainment, while strict feasibility supplies a finite multiplier; these are distinct steps. An inactive constraint can yield . At , feasibility still forces , but this strict-feasibility argument does not apply.
For a step size , define the set-valued maps
The forward subgradient step maps to the set . If is differentiable this is the explicit gradient step . The backward subgradient step consists of the satisfying , an implicit step for the subgradient flow. It is the resolvent of a monotone operator associated with .
Suppose . Then . The two defining subgradient inequalities are
Their sum proves monotonicity of a convex subdifferential, . But , so
Convexity supplies the subgradient inequalities and monotonicity; membership in the subdifferential ensures the two function values are finite, so subtraction is legitimate. Positivity of supplies the decisive sign. Properness rules out the identically infinite and negative-infinity pathologies in the overall setting, but lower semicontinuity is not needed for this at-most-one argument. Its role is in existence, proved next. The backward step cannot have two values, though uniqueness alone has not yet shown its domain is all of .
Fix and minimize . A proper lower semicontinuous convex function has an affine minorant , as follows by separating a point below its closed epigraph. Hence
The quadratic dominates the linear term, proving coercivity. Properness supplies at least one finite trial value, lower semicontinuity passes to limits, and finite-dimensional compactness makes a bounded minimizing sequence converge along a subsequence to a minimizer. Thus the proximal operator exists at every .
The subdifferential sum rule applies because the quadratic is finite and continuous everywhere. The Fermat rule for convex minimization gives
Thus the minimizer lies in . The uniqueness proved in part (a), or strict convexity of the quadratic sum, now yields
This proof displays the separate roles of properness, lower semicontinuity, convexity and finite dimension. In particular, compactness here is not inferred merely from strict convexity.
A rigorous Mumford–Shah functional permits nonsmooth image signals and free discontinuities. One classical admissible class consists of relatively closed countably rectifiable sets with finite Hausdorff measure , and with finite energy. No exterior boundary values are prescribed. For an existence argument, use the equivalent relaxed class
A special bounded-variation space excludes the Cantor part of a bounded-variation derivative of the derivative: . The jump set of a bounded-variation function is the relaxed image edge set. Clipping to decreases squared fidelity, does not increase the gradient term, and does not create jumps, so this bound loses no minimizers.
Take a minimizing sequence and compare with a constant image signal. Its gradient norms and jump lengths are bounded. Also
so the sequence is bounded in . The SBV compactness theorem for bounded values, superlinear gradient growth and bounded jump measure yields an limit in , weak convergence of gradients in , and lower semicontinuity of both the Dirichlet term and the jump measure. The uniform value bound upgrades convergence to , so fidelity converges. This proves existence of a relaxed minimizer. Essential closedness of Mumford–Shah jump sets then supplies a relatively closed representative , without added length, and . This completes the outline for the classical pair problem. Arbitrary Hausdorff convergence of image edge sets alone is not an adequate substitute for these compactness and regularity results. No uniqueness is claimed for segmentation.
As with fixed, bounded energy forces in . The reduced piecewise-constant Mumford–Shah problem is
Equivalently, use a Caccioppoli partition of the image signal domain and constants :
The relative perimeter counts only interior boundaries, and the factor one half counts each interface once. Adjacent equal-valued regions can be merged, removing unnecessary boundaries.
For fixed , let be its positive-area regions. Minimization over reduces to independent scalar least-squares fits:
The minimized fidelity is . Thus region means in piecewise-constant segmentation give the optimal grey values for a fixed segmentation.
For a fixed full spatial function , the image edge set must contain its jumps; any extra curve only adds length. The optimal choice is its essential jump set, with a relatively closed representative when appropriate. There is no independent relocation of boundaries while that full function is held fixed. A different common alternating step fixes the values but allows the labels to move. It minimizes the fidelity-plus-perimeter partition functional above. Without the perimeter term each point takes its nearest grey value; with it, interface length is penalized. At a smooth interface between two labels, outward normal displacement of has first variation
where is positive for an outward normal to a circle. The stationary segmentation interface curvature balance is
This is the geometric interpretation of optimizing boundaries with fixed grey levels, and distinguishes it from fixing the whole spatial image signal.
As with fixed, a constant competitor bounds the minimum independently of , forcing . compactness in the relaxed formulation leaves no jump or Cantor part of a bounded-variation derivative, so the limit is in on the connected rectangle. The reduced edge-free Mumford–Shah limit is
A set of zero length can be omitted; this does not impose a zero image signal or a Dirichlet boundary value. Comparison with any fixed competitor and lower semicontinuity justify the limit minimization.
For completeness, the bilinear form on is continuous and coercive, with . The right-hand side is bounded because on the bounded rectangle. The Lax-Milgram theorem gives a unique satisfying
It is the unique minimizer by strict convexity. Formally,
with the Neumann condition understood through this weak formulation. Equivalently, subtracting the weak equation shows that the energy increase at is for nonzero .
Write for the infimal convolution. It is proper by the permitted hypothesis. If and are finite, choose within of their respective infima. For , put and . Convexity of and gives
Let . If either endpoint value is infinite, the desired inequality is automatic. Thus the infimal convolution is convex, without assuming the infimum is attained.
For its convex conjugate, replace a negative infimum by a supremum and then change variables :
The two suprema separate because and are independent. Properness of and makes each supremum strictly greater than , so this separation remains valid when one or both are . Therefore . This is the conjugate of an infimal convolution. The bounded-domain assumption is unnecessary for these two calculations; the assumed properness and lower semicontinuity of will be used when applying subgradient inversion under convex conjugacy.
Apply the local bound from condition (1) separately to and . For any and , there are such that
With , both inequalities hold when , so
This is exactly continuity at . Since was arbitrary, is continuous on : upper semicontinuity of and of is equivalent to simultaneous upper semicontinuity and lower semicontinuity of .