Cauchy sequence Created 2026-09-24 Updated 2026-10-14
A Cauchy sequence is a sequence whose sufficiently late terms are all close to one another. In a metric space , the precise condition is
For real numbers with their usual metric, . The useful feature is that the definition compares computed terms to other computed terms: it does not require an already known limit of a sequence. The one index must control every pair of later indices, not merely successive terms. [ref].
For an explicit example, take for . Its tail of a sequence beginning at lies in , and for every ,
Choose with to certify the entire future sequence. For , works because . The limit of a sequence is one, but the pairwise bound establishes the Cauchy sequence property without first needing that answer. By contrast, is not a Cauchy sequence: arbitrarily late even integers and odd integers give values separated by two. [ref].
Figure 1.
A Cauchy sequence confines every sufficiently late pair to a small band; persistent alternation cannot do so
. The original geometric example has all terms with in , a band narrower than . Only finitely many terms are drawn; the formula certifies the entire tail. The alternating example continues to attain both and arbitrarily late. Details.
Tiny successive changes do not provide this guarantee. For the harmonic numbers , the successive difference tends to zero, but
Thus, beyond every proposed , choosing and defeats the fixed tolerance . Even every fixed positive lag passes the weaker test: . The failing lag grows with , as explained more generally by convergence from arbitrary variable-lag increments. [ref].
Figure 2.
Harmonic numbers take vanishing successive steps while retaining a nonvanishing gap between indices and
. The blue curve is ; the red curve is . The exact lower bound holds for every positive integer , not just the plotted sample. The shaded region between and in the right panel illustrates how many individually small terms produce a substantial gap. Details.
Every convergent sequence in a metric space is a Cauchy sequence: apply the triangle inequality to two late terms and their common limit of a sequence. The reverse implication requires completeness. It holds in the real numbers by completeness of the real numbers, but can fail in the rational numbers: the rational endpoints from the bisection method approaching are a Cauchy sequence with no rational limit of a sequence. The existing construction in completeness of the real numbers shows how this happens. A Cauchy sequence is always a bounded sequence; in , boundedness gives a convergent subsequence by the Bolzano-Weierstrass theorem, and the pairwise condition forces the whole sequence to share its limit. [ref].
On a separable metric space, a sequence uniformly bounded in bounded Lipschitz norm has a pointwise convergent subsequence. Enumerate a countable dense subset and use the Bolzano-Weierstrass theorem and diagonal subsequence argument to obtain convergence there. Uniform control of the Lipschitz constant then makes the subsequence Cauchy at every point. The pointwise closure of the bounded Lipschitz unit ball preserves the original norm bound after rescaling.
Extended real subsequence theorem Created 2026-10-14 Updated 2026-10-14
Every real sequence has a subsequence converging to an extended real number. A bounded sequence has a real convergent subsequence by the Bolzano-Weierstrass theorem. If it is unbounded above, every tail is unbounded above, so choose increasing indices with . These terms tend to positive infinity. If it is unbounded below, use .
Extreme value theorem Created 2026-09-24 Updated 2026-10-14
A real-valued function that is continuous on a nonempty compact space attains both a global minimum and a global maximum. In particular, for a continuous function on a nonempty closed interval, there are points such that
The important word is “attains”: the best values occur at actual allowed inputs, rather than merely being approached. The interval version is [ref].
For a worked example, take on . Its global minimum is , and its global maximum is . Nonnegativity gives the first answer; on the specified closed interval gives the second. The endpoint is essential: looking only for a zero derivative would find the minimum and miss the maximum.
Figure 1.
An attained minimum and maximum on a closed interval, compared with excluded endpoints and a discontinuous endpoint value
. Details.
For comparison, the continuous function on the open interval has infimum and supremum , but neither is a value of . Even a closed domain is insufficient without continuity: define for , and . On , its supremum is , approached by for , but every function value is strictly less than . This endpoint change makes discontinuous, preventing attainment. On the unbounded real line, the continuous function has neither a global minimum nor a global maximum. These examples show what can fail when a hypothesis is dropped; functions outside the hypotheses may still have extrema.
The extreme value theorem is an existence tool for optimization: first establish that a continuous objective function on a nonempty compact feasible set has a best value, then investigate where it occurs. It neither locates the optimizing point nor promises uniqueness or differentiability. For example, the absolute value function on has its global minimum at zero although no derivative exists there; a constant function has every input as a minimizer. This role in optimization is explained in University of Toronto MAT237 notes, section 1.4: compactness and the extreme value theorem.
A short proof outline identifies the mechanism. The continuous image of a compact space is compact; a nonempty compact subset of the real line contains its infimum and supremum. For a closed interval, one can instead choose inputs whose outputs approach the supremum, extract a convergent subsequence by the Bolzano-Weierstrass theorem, and use continuity to make its limiting output equal that supremum. The closed interval retains the limiting input. Repeating the argument for the infimum supplies the minimum.
Heine-Borel theorem Created 2026-09-29 Updated 2026-10-14
For every finite , a subset of Euclidean space is compact if and only if it is a closed set and a bounded set. Here closed means closed in the ambient Euclidean space, not merely in itself, and the bounded set condition uses the Euclidean norm. The empty set is included: it is a closed set, a bounded set, and compact. [ref]
This makes an apparently infinite test practical. To verify compactness of a closed interval with finite endpoints, we need not examine every open cover: it is closed in the real line and a bounded set. By contrast, the open interval is a bounded set but is not closed in the real line, as the missing-endpoint figure in compact space illustrates. The whole real line is closed but is not a bounded set, so it too fails compactness. These examples show why both hypotheses are needed.
The same criterion holds in any real or complex finite-dimensional vector space equipped with a norm: all norms there are equivalent norms, so they give the same open sets, closed sets, and bounded sets. Since compactness depends only on the topology, choosing a different norm does not change the conclusion. Without an appropriate topology, a bare vector space alone has no notion of compactness.
The restriction to a finite-dimensional vector space is essential. In the l2 sequence space, an infinite-dimensional vector space that is also a Hilbert space, let be the vectors of its standard orthonormal basis. All lie in the closed unit ball , which is a closed set and a bounded set in the norm topology. For distinct indices, their inner product is zero, giving
Thus distinct terms remain distance apart. No subsequence is a Cauchy sequence, hence none is a convergent sequence. The equivalence of compactness and sequential compactness in a metric space proves that this closed unit ball is not compact. The conclusion concerns the norm topology.
A short proof outline in Euclidean space explains the role of a finite-dimensional vector space. For a sequence in a bounded set, apply the Bolzano-Weierstrass theorem to each of the Cartesian coordinates in turn, retaining a subsequence at each of the finitely many steps. The final subsequence is a convergent sequence in all Cartesian coordinates, and a closed set contains its limit of a sequence. This yields sequential compactness, hence compactness. Conversely, a compact subset of a metric space is a closed set and a bounded set. [ref]
Let be continuous on a closed bounded interval . First prove that is a bounded function. If it failed, we could choose with . The Bolzano-Weierstrass theorem gives a subsequence . Because the interval is closed, . Continuity gives , contradicting .
Now let , which exists by completeness of the real numbers and the bound just proved. Choose with . A convergent subsequence has limit of a sequence , and continuity gives . Applying the same argument to gives attainment of the infimum. This proves the extreme value theorem: the maximum and minimum both exist and are attained. The argument also covers a one-point interval, where the conclusions are immediate.
Here is a nested-interval proof of the Bolzano-Weierstrass theorem. Put every term of the bounded real sequence in a closed interval , with . Bisect this interval and choose a closed half containing infinitely many terms. Repeating gives nested closed intervals , each containing infinitely many sequence terms, with length .
By the least-upper-bound property, exists. For each , every lower endpoint lies at most , while ; hence . Choose increasing indices with , possible because each interval contains infinitely many terms. Then
Thus every bounded real sequence has a convergent subsequence.
For a sequence with no convergent subsequence, take : any subsequence has , so its terms tend to positive infinity rather than to a finite limit of a sequence. For an unbounded sequence with a convergent subsequence, take and . Its odd terms are unbounded, while its even subsequence converges to zero.
We prove the equivalence by a cycle of implications. First assume closedness and boundedness. Given a sequence in , boundedness puts each coordinate in a fixed closed bounded real interval. Apply the one-dimensional Bolzano-Weierstrass theorem to its first coordinate to extract a convergent subsequence, then apply it to the second coordinate of that subsequence, and continue through the finitely many coordinates. The final subsequence converges coordinatewise to some . It also converges in the Euclidean norm, since the sum of the squares of its finitely many coordinate differences tends to zero. Since is a closed set, this limit belongs to . Thus closedness and boundedness imply the required subsequence property. No higher-dimensional compactness theorem has been assumed.
A real sequence has limit if, for every , there is such that for all . It tends to if, for every real , eventually ; it tends to if eventually for every real .
The Bolzano-Weierstrass theorem states that every bounded sequence of real numbers has a real convergent subsequence. This proves the claim for bounded sequences. If the sequence is unbounded above, every tail remains unbounded above because a finite prefix is bounded. Choose indices increasing with . This subsequence tends to . If it is unbounded below, choose to obtain a subsequence tending to . This proves the extended real subsequence theorem.
For the final example, a bounded sequence with vanishing increments need not converge. Take
The mean value theorem gives
Nevertheless, along , the square-root rounding error tends to zero, so . Along , it tends to . These two subsequences have different limits, proving nonconvergence.
To prove boundedness on , suppose instead that is unbounded and choose with . The Bolzano-Weierstrass theorem gives a subsequence converging to . Continuity then gives , contradicting . Hence is bounded.
Let and . Choose with . Another application of Bolzano-Weierstrass theorem yields a subsequence tending to , and continuity gives . Applying the same argument to gives with . Thus
This proves the extreme value theorem here, including both attainment assertions.
For , its two limits supply such that whenever . On , continuity and the result just proved give a finite bound . Consequently on the whole real line.
For the final value assertion, if , take . Otherwise . The positive-infinity limit gives a point with , so . The intermediate value theorem on now gives with
Positivity of is essential to this tail argument; a function can tend to zero without ever attaining zero.
For a bounded function, a partition of an interval is . Put and . Its lower Darboux sum and upper Darboux sum are
The lower Darboux integral is and the upper Darboux integral is . Riemann integrability means that these two real numbers coincide, and their common value is the Riemann integral.
Equivalently, the Riemann integrability criterion says that for every some partition satisfies . To see equivalence, all lower sums are at most all upper sums: refine any two partitions to their common refinement and use Darboux sum refinement monotonicity. Thus a small gap forces the difference of the two integrals below . Conversely, if both integrals equal , choose a lower sum above and an upper sum below ; their common refinement has gap below .
This also agrees with the tagged Riemann sum definition: there is such that every tagged sum on a partition of sufficiently small mesh is within any prescribed tolerance of . Each tagged sum lies between the two Darboux sums. From a partition with small gap, an arbitrary small-mesh partition differs from its refinement at only the cells crossing the finitely many original division points; boundedness makes their total contribution tend to zero. Conversely, on a fine partition tags approximating each cell supremum or infimum force both Darboux sums close to the same tagged-sum limit.
Now suppose is continuous on . It is bounded by the result of Question 11. It is also uniformly continuous: otherwise there are with but . The Bolzano-Weierstrass theorem gives a convergent subsequence of ; the corresponding have the same limit, contradicting continuity. Given , this uniform continuity gives such that points less than apart have function values less than apart. A partition of mesh below then satisfies
Hence every continuous function on the interval is Riemann integrable, with the required proof supplied by its oscillation estimates.
The Baire category theorem states that, in a nonempty complete metric space, a countable intersection of open dense sets is dense. Equivalently, a nonempty open set cannot be covered by countably many nowhere dense sets.
For the Uniform boundedness principle, let be a Banach space, a normed vector space, and a family of bounded linear operators for which for every . Put
Each is closed, being an intersection of inverse images of closed balls, and . By the Baire category theorem, some has interior. Choose a closed ball with . For , both and belong to , and linearity gives . Scaling yields
Completeness is needed for the domain, not the codomain.
We next prove the Silverman-Toeplitz theorem. Write for the real convergent sequence space with the supremum norm. It is a Banach space: the l-infinity sequence space is complete by coordinatewise passage to limits of norm-Cauchy sequences, and is closed in it. Indeed, if uniformly and each converges, approximate within by one and make that sequence's tail oscillation smaller than . Then the tail of is Cauchy and therefore converges in .
Suppose is a regular summability matrix. Fix a row and consider the finite bounded linear functionals
For every their values converge, by the definition of regularity, and are therefore bounded. Their operator norms are exactly : the upper bound is the triangle inequality, and the finite sign sequence for , zero afterwards, attains it. Applying the Uniform boundedness principle to this row shows .
Consequently the full row functional is continuous and has norm , using the same finite sign tests and then letting . Regularity makes convergent, hence bounded, for every . A second application of the Uniform boundedness principle gives a common row bound . Testing regularity on a coordinate vector and on the constant-one sequence gives, respectively, convergence to zero down each column and convergence of row sums to one. Thus the necessary conditions are
Conversely assume these conditions and let . The sequence is bounded, so every row sum defining converges absolutely. Write
Given , choose such that for . The tail of the first sum has modulus at most , uniformly in . Its finite head tends to zero by columnwise convergence, and . Since is arbitrary, . The three conditions are necessary and sufficient for regularity.
For the averaging matrix , every absolute row sum and every row sum equals . A fixed column eventually has entry . Thus is a regular summability matrix, and its transformed values are the Cesàro means. To exhibit a bounded sequence without a Cesaro limit, put , for , and set
At the end of the th block,
The averages at even block endpoints approach , while those at odd endpoints approach . Hence is bounded and has no -limit.
For an arbitrary regular summability matrix , use a gliding hump argument; this also handles negative entries. Put and . Inductively choose so large that
This is possible by the finite-column convergence and convergence of the row sums to one. Since the selected row is absolutely summable, choose with
Define a single bounded sequence on the successive disjoint blocks by
using . The row's absolute mass on its own block is greater than , while all coordinates outside that block contribute a term of modulus less than , irrespective of the signs subsequently assigned. Therefore
Even and odd selected rows cannot tend to the same limit. Every row series does converge absolutely because . This proves bounded divergence for every regular summability matrix.
The row bound makes , , a bounded linear operator with . The summability domain of a regular matrix is
Since is closed, this is a closed linear subspace. It is proper by the constructed . A proper vector subspace of a normed vector space has empty interior: a ball in the subspace can be translated to a ball about zero, and scaling that ball would put every vector in the subspace. Thus
For a countable family of regular matrices, the Baire category theorem on the Banach space gives
Any vector in this complement has none of the indicated matrix limits. The matrices in this clause must be regular, as in the preceding discussion; without that implicit qualification even a single zero matrix sums every bounded sequence to zero.
Finally take any bounded sequence . By the Bolzano-Weierstrass theorem it has a subsequence with strictly increasing. Define the selector matrix
Its absolute row sums and row sums are , and each fixed column is eventually zero. The Silverman-Toeplitz theorem makes it regular, while . Thus every bounded sequence is summable by some regular matrix depending on that sequence. This is subsequence selection as regular matrix summability; it reverses the quantifier order of the impossibility result for a fixed matrix.
Two norms are Lipschitz equivalent norms when constants satisfy for every vector . Applying these inequalities to shows that a sequence is a Cauchy sequence for one norm exactly when it is so for the other; applying them to likewise equates convergence. If one norm is complete, a Cauchy sequence for the other converges using the first norm and hence also the second. Interchanging the norms proves completeness is preserved in both directions.
Write and set . If , then , and the triangle inequality gives
Scaling a nonzero gives for every . The reverse triangle inequality now implies
so is continuous, indeed Lipschitz, in the Euclidean norm.
Suppose there were no positive lower bound on the Euclidean unit sphere. We could choose with but . The Bolzano-Weierstrass theorem supplies a subsequence converging in the Euclidean norm to . Continuity of both norms gives and , contradicting definiteness. Therefore some satisfies on the unit sphere. Scaling again proves the finite-dimensional equivalence of norms:
Set , an entire function. By the Bolzano-Weierstrass theorem, a subsequence of the distinct zeros converges to a point in the closed unit disc. An analytic function has a convergent Taylor series in a neighbourhood of each point. If the first nonzero coefficient of at had index , then
with analytic and nonzero in a sufficiently small disc. The zero would then be isolated, contradicting the accumulating distinct zeros. All Taylor coefficients at vanish, so vanishes on a disc.
To justify continuation across the whole plane, let be the set of points at which vanishes on a neighbourhood. This set is nonempty and open. It is also closed: if points of tend to , continuity of each derivative gives for every , and the Taylor series at gives a zero neighbourhood. Since is a connected space, . This proves the identity theorem here and gives .
Without boundedness, the distinct zeros need not have an accumulation point in the plane. For example,
are distinct entire functions agreeing at all the indicated positive integers.
Write and . The quantity in the question is the bounded Lipschitz norm . Both terms are nonnegative and absolutely homogeneous, and each satisfies the triangle inequality. Therefore their sum does too; finite values are preserved by addition and scalar multiplication, making the domain a vector space. If the sum is zero, forces . Thus it is a norm.
For the sequence bounded by one, both and . Given real , choose a nearby rational . Then
First make small, then use convergence at to make the last term small. The values at every real form a Cauchy sequence, so converges pointwise to a real function .
To preserve the sum bound rather than merely bound its two terms separately, use every fixed triple :
Pass to the pointwise limit and take the independent suprema over and . This gives , the pointwise closure of the bounded Lipschitz unit ball.
To obtain diagonal compactness for bounded Lipschitz functions, enumerate the rationals for an arbitrary sequence in this unit ball. Values at the first rational lie in , so the Bolzano-Weierstrass theorem supplies a convergent subsequence there. Repeatedly extract nested subsequences for successive rationals. The diagonal subsequence argument gives one subsequence converging at every rational. Applying the preceding argument proves there is a pointwise convergent subsequence with limit of bounded Lipschitz norm at most one.
The Bolzano-Weierstrass theorem states that every bounded sequence in has a convergent subsequence. More generally, a bounded sequence in has a subsequence converging to a point of .
Let , and choose a minimizing sequence with . Since , discarding finitely many terms ensures .
Fix distinct nodes . The Lagrange interpolation formula expresses
The vector of node values is bounded in , so the Bolzano-Weierstrass theorem supplies a subsequence converging to . Put , of degree at most . Because the are fixed bounded functions,
along that subsequence. The reverse triangle inequality implies . Thus a best uniform approximation exists, with no appeal to an unproved abstract existence result.
Here is the vector space of real polynomials of degree at most .
Two Lipschitz equivalent norms satisfy for all , for constants . These inequalities give the same convergent sequences in both norms. A subset of a metric space is closed exactly when it contains the limits of all convergent sequences from that subset. Therefore closedness is the same in the two norms.
For finite dimension, fix a basis and let . For any norm ,
The reverse triangle inequality then makes continuous in the Euclidean coordinate norm. If no positive lower bound existed on the Euclidean unit sphere, choose there with . By the Bolzano-Weierstrass theorem, a subsequence converges to on the unit sphere. Continuity would give , although , a contradiction. Thus is bounded below by a positive multiple of the Euclidean norm. Comparing any two norms through that coordinate norm proves all norms in finite dimension are Lipschitz equivalent.
On , nonnegativity, absolute homogeneity and the triangle inequality for follow from the corresponding real-number properties and integration. If a continuous is nonzero at a point, it has absolute value bounded below by a positive constant on a nontrivial one-sided or two-sided interval around that point. Its integral is then positive. Hence implies , completing the norm axioms.
For , put and . Then , but
The limit function is not in the indicated point evaluation kernel. Consequently that set is not closed in the integral norm. This is the point-evaluation kernel is not closed in the integral norm phenomenon.
Finally while . Thus no constant can bound the uniform norm by a multiple of the integral norm. Although on this unit interval, the converse comparison fails: the two norms are not Lipschitz equivalent. The finite-dimensional theorem cannot be applied to this infinite-dimensional function space.
True. Boundedness follows from . To prove closedness of the Minkowski sum, let converge to . By the Bolzano-Weierstrass theorem, the bounded sequence has a subsequence converging to . Closedness gives . Along that subsequence, , which belongs to by closedness. Thus . This proves that the sum is bounded and closed.
We use the Bolzano-Weierstrass theorem: every bounded real sequence has a convergent subsequence. If were unbounded on , there would be with . The Bolzano-Weierstrass theorem gives a subsequence , and the closed interval contains . Since is a continuous function, , contradicting . Thus is bounded.
Let . By the definition of the supremum, choose with . Again the Bolzano-Weierstrass theorem gives . Continuity yields . Applying the same argument to gives a point where attains its infimum. Therefore both the supremum and the infimum are attained. This proves the extreme value theorem for a closed bounded interval.