Suppose is nonnegative and sequentially lower semicontinuous, and its sublevel sets are strongly sequentially compact. For a solvable exact equation , every sequence of residual-method minimizers with has a strongly convergent subsequence, and every limit is a J-minimizing solution. Indeed, comparison with an exact penalty minimizer bounds all reconstructions in one compact sublevel set; the residual bound gives . Continuity of and lower semicontinuity of identify each subsequential limit as an exact minimizer. Thus the distance to a set of exact penalty minimizers tends to zero. Uniqueness of the exact minimizer upgrades this to full strong convergence.
Uniqueness cannot be omitted: for , , and on , the sublevel sets are compact intervals but the minimizers do not converge.
In a metric space , let the nonempty compact set lie in the open set . If is nonempty, the distance to a set is a continuous function of : the triangle inequality gives . Since is a closed set, this distance is strictly positive on . The extreme value theorem attains its minimum on , so
If is empty, the extended-real convention gives . This result provides a single positive neighbourhood radius that stays inside at every point of . Compactness is essential: in the real line has zero distance between two sets from , although each point of has positive distance to a set from that complement.
For any nonempty complete metric space , the family of its nonempty closed bounded subsets is a complete metric space under the Hausdorff distance. Boundedness of the entire ambient space is unnecessary in this general form.
For a Cauchy sequence of these sets, define and . A Cauchy sequence in any metric space is bounded, so its tail sets are contained in a common finite-radius neighbourhood of one bounded ; hence every is bounded. The distance to a set is one-Lipschitz, so estimates pass to the closure, giving and for . Choose with . The Summably nested Hausdorff intersection theorem gives . The triangle inequality now gives , proving completeness.
Distance to a set Created 2026-09-24 Updated 2026-10-25
For a nonempty subset of a metric space, the distance to a set is . The triangle inequality gives ; swapping proves . Thus it is one-Lipschitz. Its zero set is exactly the closure of : every neighbourhood of meets precisely when this infimum vanishes. For a closed set, zero distance therefore implies membership. When the empty set is allowed, use the convention ; the finite-valued Lipschitz assertion applies to nonempty sets.
Metric Tietze two-thirds approximation Created 2026-10-14 Updated 2026-10-31
For a real function in the bounded continuous functions of norm on a closed subset of a metric space, separate its closed level sets and by . The distance to a set functions make continuous with the displayed bounds. Empty level sets are handled by the constants , or . Iterating on the residual yields a uniformly convergent continuous extension with no increase in the supremum norm.
For a finite open cover of , take continuous nonnegative functions summing to one and positive only in . Such a partition of unity comes from normalizing the distance to a set functions . The Borsuk-Ulam theorem applied to gives equal values at an antipodal pair. The sum condition makes equal too, and some common positive value places both points in one .
If , using in the infimum gives , so .
Conversely, if , the definition of the infimum allows a choice with . The sequence is therefore a convergent sequence with limit . Since is a closed set, its limit belongs to . Hence
Closedness matters: without it, zero distance to a set characterizes its closure, which can contain additional points.
The distance to a set is nonnegative and finite here: any fixed gives . For every , the triangle inequality gives
Taking the infimum over yields . Interchanging and proves
Thus is a Lipschitz function with Lipschitz constant one, so it is continuous. In the epsilon-delta definition of continuity, choose .
Start with the approximate surjectivity with geometric correction argument. For a fixed , put . Choose successively so that
Induction gives and . The series is absolutely convergent in the Banach space , because the sum of its norms is bounded by the convergent geometric series . Write its sum as . The bounded linear operator commutes with this limit, while . Consequently
The choices need not depend linearly on ; no bounded linear right inverse is being asserted.
For the bounded extension, use the restriction bounded linear operator on the Banach spaces of bounded continuous functions, each with its supremum norm. We will construct an approximation to any with . The two sets
are disjoint closed sets in , since is closed. If both are nonempty, the distance to a set construction defines a continuous function
The denominator is positive at every point: zero distance to a closed set means membership in that set. Thus , with on and on . On and , and also on the intervening range , this implies
If only is empty take , if only is empty take , and if both are empty take ; the same bounds hold. For take . This proves the approximation hypothesis with and . Applying the argument above to yields an element of the bounded continuous functions with and . Restriction gives the reverse inequality, so the extension preserves the exact supremum norm:
This proves the bounded metric-space case of the Tietze extension theorem rather than presupposing it.
For an arbitrary real continuous function on , let . Its values lie strictly between and , although its supremum norm can be . The bounded result supplies an extension with . Let , a closed set disjoint from . If is nonempty and is nonempty, put
Both factors are continuous functions; on and on . Off we have , and on we have , so everywhere. Therefore a real continuous extension is
On it equals . If is empty use ; if is empty simply take . This handles unbounded without requiring a uniform margin between and .
For nonempty , the triangle inequality gives for every . Taking the infimum yields . Interchanging proves
Thus the distance to a set is a Lipschitz function, hence continuous. If and is closed, its open complement contains a ball ; every point of is at least away. Hence for .
For two nonempty disjoint closed sets, let . It is continuous, negative on and positive on . The disjoint open sets and contain them. Empty sets cause no difficulty, using an empty neighborhood for the empty set. This proves every metric space is a normal topological space.
In any normal space, a closed contained in an open can be separated from : choose disjoint open and . Because is closed and contains , . First choose disjoint open around , then apply this argument separately to each pair . It gives , and therefore . This is closed-neighborhood shrinking in a normal space.
For the two specified hyperbola branches, explicit choices are
They are open and contain the branches with products and . Their closures lie respectively in and . Any common point would have , making both product inequalities impossible. Thus their closures are disjoint even though the original branches can approach one another arbitrarily closely at large height.
We prove the required Hahn-Banach theorem for a seminorm directly. First suppose the vector space is real. At an intermediate extension stage, let be a linear functional with , and let . Extending to amounts to choosing . The upper domination requires
The interval is nonempty: for all ,
Its endpoints are finite since inserting zero gives bounds and , while every lower candidate is below every upper candidate. Choose in the interval and put . For , the upper bound with proves . For , writing and applying the lower bound with proves the same inequality. The case is already known. Applying this domination to and using gives .
Partially order all dominated linear functional extensions of the original by extension of their domains and values. They form a nonempty set. The union along any chain is a well-defined dominated linear functional on a vector subspace, so every chain has an upper bound. The Zorn lemma gives a maximal extension. If its domain were not , the preceding one-dimensional construction would enlarge it, a contradiction. Thus the required extension exists on .
For a complex vector space, apply the proved real result to on the underlying real vector subspace. Let be the resulting real linear functional, with , and set
It is additive and real-linear, and , so it is complex-linear. On , the identity proves . Choose with and when . Then
The bound is immediate if . This proves the real and complex seminorm forms of Hahn-Banach theorem without invoking any version of that theorem.
For the distance to a set assertion, let . Define on the linear functional . The decomposition is unique because , and for ,
For the bound is immediate. Apply the just-proved Hahn-Banach theorem with to get , , , and . Choose with . Since
and , passage to the limit gives . Thus . This version of the Hahn-Banach distance formula needs neither a closed nor an attained distance to a set.
For the Banach limit construction below, take the real l-infinity sequence space, let be its left shift on bounded sequences, put , and let . This is a vector subspace and its distance to a set from determines the construction.
The assumptions prove convergence to the set of J-minimizing solutions, and subsequential convergence to a member of that set. Convergence to a single fixed member requires uniqueness or a suitable selection rule.
Let be any J-minimizing solution, whose existence is granted. It is feasible for every noisy-data constraint because and . Minimality therefore gives . All reconstructions lie in this strongly sequentially compact space sublevel set. For any sequence , pass to a subsequence with . Boundedness of and the triangle inequality imply
so . By sequential lower semicontinuity,
Thus is a J-minimizing solution. The same compactness argument shows the distance to a set of exact minimizers tends to zero: otherwise a subsequence at a fixed positive distance would converge to an exact minimizer, a contradiction. If that minimizer is unique, every convergent subsequence has the same limit, giving the asserted full strong convergence.
For a counterexample to full convergence under the printed hypotheses alone, take , , , and . This is nonnegative and continuous, with compact sublevel sets for . Every point of is both an exact and a residual-method minimizer. Choosing gives a valid sequence of minimizers that does not converge. The reusable corrected statement is compact-sublevel convergence of the residual method.
For a harmonic function , let
The divergence theorem gives
Since as , . Integrating the spherical averages in the radial variable gives the corresponding ball average, proving the mean value property for harmonic functions. If attains its maximum at an interior point, the average of the nonnegative function on every sufficiently small centred sphere is zero. Continuity makes constant on those spheres, and connectedness propagates that value through the domain. Thus the weak maximum principle for elliptic operators gives
For the derivative estimate, choose smaller than half the distance from to , and let be a smooth radial mollifier supported in . Writing its convolution in polar coordinates and using the spherical mean value property shows that on . Hence, for every multi-index ,
so Holder inequality gives
First suppose is a closed set. If , the definition in part (ii) gives an open ball disjoint from . Thus every has , and the distance to a set satisfies . Its contrapositive is the required implication.
Conversely, suppose that zero distance to a set forces membership. For we have . Choose . Then , proving is an open set. Hence
For , use the extended-real convention : both assertions hold, with the implication vacuous. Part (b) only uses nonempty sets, so all its distances to a set are ordinary finite real numbers.
Let be a Cauchy sequence for the Hausdorff distance, and put
The bounded set hypothesis makes finite, and the Cauchy sequence property gives . Each is nonempty and a closed set, with .
We need estimates that survive taking the closure. For every nonempty , the distance to a set is Lipschitz continuous with constant one: the triangle inequality gives , and interchanging proves
For every , points of have distance at most from . The same holds throughout their union and its closure, by this continuity. Since ,
More generally, if , every point in is within of . Passing to its closure again, and using , gives
Choose strictly increasing indices with . Then satisfies part (ii), so it converges in Hausdorff distance to the nonempty closed set , with .
For , the triangle inequality gives the explicit full-sequence bound
It tends to zero as . Therefore
This proves Completeness of the Hausdorff hyperspace using the proposed tail closures, rather than assuming their diameters shrink.
The intersection is a closed set because arbitrary intersections of closed sets are closed. Its nonemptiness needs a construction: bounded closed sets need not be compact sets in this setting.
Fix , , and . Recursively choose , for , using the approximation property of an infimum so that
This is possible because and . The two bounds form convergent geometric series, so the triangle inequality shows is a Cauchy sequence. By completeness it converges to some .
For each fixed , all sufficiently late lie in , by nesting. Closedness of gives , and hence . In particular, starting with any proves . Moreover,
For each starting point , let in this bound on its distance to a set . This does not assert that a nearest point exists. It proves . Since , the other directed Hausdorff distance is zero, and
This is the Summably nested Hausdorff intersection theorem; the summable movement replaces any need for compactness.
Write , so that is the Hausdorff distance. Since is a bounded set, there is a finite with . Nonemptiness of therefore gives , so is finite. Its symmetry and nonnegativity are immediate, as is .
If , then every has zero distance to a set . Since is a closed set, part (a)(iii) gives . Interchanging the sets gives . Thus implies . Closedness is essential here: without it a set and its closure have Hausdorff distance zero.
For the triangle inequality, fix and . The approximation property of an infimum supplies with , and then with . Consequently,
Let and take the supremum over to obtain . Applying this inequality in the reverse direction as well yields
All metric axioms follow. Boundedness was used to ensure finiteness, and closedness to distinguish different sets; neither was needed for the triangle inequality.
The distance to a set is finite and nonnegative because is nonempty. For and every , the triangle inequality gives
Taking the infimum over yields . Interchanging and gives the opposite inequality. Together these imply
Thus the distance to a set is -Lipschitz continuous. No closedness, compactness or attainment of the infimum was used.
The intended hypothesis is that is not connected. The original PDF has the same grammatical ambiguity as the transcription. If only were assumed not connected, the assertion would fail for the discrete space with its usual metric and the closed subset : two disjoint sets cannot both meet that singleton.
Under the intended reading, choose a separation of a topological space . Both and are nonempty and closed in , because each is the complement of the other relatively open part. Since is closed in , both are closed in .
For a nonempty subset of the metric space , the distance to a set satisfies
Indeed, the triangle inequality gives , and swapping proves the bound. Thus the two distance to a set functions below are continuous. Set
These are disjoint open sets. For , we have and , since is closed and . Hence . Similarly . Therefore and both and meet , as required. The construction is a concrete instance of the normality of every metric space.
Spectrum of a bounded operator Created 2026-09-28 Updated 2026-10-14
Let be a Banach space over the complex numbers, and let be a bounded linear operator defined on all of . Its spectrum consists of those for which has no everywhere-defined bounded inverse. Its complement is the resolvent set of an operator . By the bounded inverse theorem, a bijective automatically has a bounded inverse. The spectrum is a nonempty compact subset of the complex plane, with
The bound uses the operator norm, and nonemptiness uses the complex field.[ref] For a real linear operator, complex spectral values are understood by extending it to a complex vector space; restricting to the real field can give an empty set.
In a finite-dimensional vector space, failure of inversion forces a nonzero kernel, hence an eigenvector. An infinite-dimensional vector space allows an injective shifted linear operator that cannot solve every equation . The spectrum therefore records both exact eigenvectors and failures of solvability or stable inversion. Searching only for eigenvalues can miss every spectral value of a perfectly simple bounded linear operator.
Consider the multiplication operator on the complex L2 space , with Lebesgue measure:
Its operator norm is one. The inequality gives the upper bound; unit vectors concentrated near approach it. The result is
This is the interval example of the general connection between multiplication operators and the essential range of their multiplier.[ref] Indeed, an eigenfunction would satisfy almost everywhere. It vanishes except possibly on the singleton , a null set; such a function is the zero vector in L2 space. Concentrating at one point cannot produce a nonzero L2 function.
For , the inverse is completely explicit:
The distance to a set is positive, so the inverse multiplier is bounded. Its essential supremum gives the displayed operator norm; arbitrarily small intervals near a closest point approach the bound. Our resolvent of an operator uses , the negative of this inverse, with the same operator norm. For , , and , the inverse norms are respectively , , and . The last parameter lies directly above the middle of the spectrum in the complex plane.
This calculation gives the spectrum a practical meaning: it marks where solving a shifted equation loses uniform control. At , the largest amplification of an input error is . Changing from to increases that factor from ten to one hundred. The equation remains uniquely solvable for each nonzero , but its sensitivity grows as the parameter approaches the spectrum.
Figure 1.
An interval without eigenvectors and a diagonal spectrum accumulating at zero
. Details.
To see directly why every belongs to the spectrum, choose and define a clipped interval and a normalized indicator function:
Its L2 norm is exactly one, including at both endpoints. On its support, , giving
Thus any choice produces approximate eigenvectors. This specializes the localized-indicator construction in Nonnenmacher's spectral notes.[ref] A hypothetical bounded inverse would imply , impossible for arbitrarily small .
For an interior point with , and the residual is exactly . At or , and the same residual formula holds, but the amplitude is rather than . At , taking gives amplitudes approximately and residuals . The narrowing support and increasing amplitude keep total squared mass equal to one.
For every , the continuous spectrum description is also concrete. Any L2 function can be approximated in L2 norm by its truncations to . Each truncation lies in the range of , since division there is bounded. The range is therefore dense. However, the constant function has no L2 function preimage: is not square-integrable, including at the endpoints.
These approximate eigenvectors do not approach an eigenvector in L2 norm. Any possible limit would have L2 norm one and satisfy by continuity, contradicting the empty point spectrum. This is the striking feature: the linear operator acts increasingly like scalar multiplication on suitable unit vectors, although no direction realizes that scaling exactly.
Figure 2.
Unit L2 vectors concentrate while their spectral residual tends to zero
. Details.
A complementary example is the diagonal operator on sequence space on complex l2 sequence space, with . The coordinate unit vectors satisfy , so
Zero is not an eigenvalue, since forces every coordinate to vanish. Nevertheless : these are approximate eigenvectors at zero. More concretely, belongs to l2 sequence space, but would require for all , which does not. Outside the displayed closed set, division by is uniformly bounded, proving that no further spectral values occur. Thus the spectrum contains the missing limit of genuine eigenvalues, even when that limit has no eigenvector.