Bi-Lipschitz map 2026-10-14
A bi-Lipschitz map between metric spaces satisfies the displayed bounds for all input pairs, with constants . The lower bound makes it injective; its inverse on its image is Lipschitz continuous with bound , while the map itself has Lipschitz bound . Thus it controls both stretching and compression. It is a homeomorphism onto its image, preserves Hausdorff dimension, and has bi-Lipschitz distortion at most . Uniformly multiplying every distance by the same positive factor has distortion one, as explained in metric embedding.
Finite net Created 2026-10-06 Updated 2026-10-14
An -net of a metric space is a set such that every point lies within distance of a point of . A Cartesian grid of coordinate spacing is a finite -net of a bounded cube in the Euclidean norm. A Lipschitz bound transfers control on the grid to control over the whole cube.
Globally Lipschitz function Created 2026-09-28 Updated 2026-10-14
A function is globally Lipschitz when one finite Lipschitz bound holds for every pair in its entire specified domain of a function. The sine and the absolute value have this property on the real line. For any reference point , a globally Lipschitz continuous real function obeys , so its size grows at most linearly in the distance from .
The function is a locally Lipschitz function on the real line, but is not globally Lipschitz there: pairs , have ratio , which is unbounded. Restricting the domain to does give a global bound . Global and local describe where one bound must work, rather than two intrinsic labels independent of the domain.
For a strictly positive probability density function with Lipschitz bound , satisfies . If and , monotonicity gives and hence . The Lipschitz density height bound prevents extending this local argument to every by assuming for a strictly positive density.
Lipschitz constant Created 2026-09-29 Updated 2026-10-14
The Lipschitz constant is the least nonnegative number that works in the defining Lipschitz bound, equivalently the displayed supremum of distance ratios. A constant function has constant zero; for a domain with at most one point we also set it to zero. An infinite supremum means there is no finite Lipschitz bound. The least constant need not be attained by one pair of inputs.
For on the real line, every distinct pair has ratio , so the Lipschitz constant is . For on , with ,
Pairs , have ratio , approaching . Thus the Lipschitz constant is , although no distinct pair realizes that exact value. Reporting the domain is essential: the same function has no finite global Lipschitz constant on .
Lipschitz continuity Created 2026-09-24 Updated 2026-10-14
A function between metric spaces is Lipschitz continuous if one finite number controls every change of output by the corresponding change of input:
For real inputs and outputs this is . The same bound must work for every pair in the specified domain of a function. It gives a quantitative version of continuity: an input error of at most produces an output error of at most . The least possible bound is the Lipschitz constant. Lebl presents the real and metric-space definitions and their connection with uniform continuity. [ref]
Three functions show why this condition differs from differentiability. The absolute value has a corner at zero, but the reverse triangle inequality gives , so it has Lipschitz constant one on the real line. The sine is smooth and also has Lipschitz constant one: the mean value theorem and bound every secant slope. The square root is continuous on , but
No finite Lipschitz bound works on that interval. At , the ratios are . Smaller input changes near zero therefore require larger amplification factors.
Figure 1.
Bounded secant slopes permit a corner, while the square root needs unbounded amplification near zero
. Details.
For a real function, Lipschitz continuity means that the absolute slopes of all secant lines are bounded. If the derivative exists at a point, taking a limit of those slopes gives . In the other direction, a function that is continuous on a real interval, differentiable in its interior, and satisfies there is Lipschitz continuous by the mean value theorem. The interval hypothesis matters: the theorem uses the segment connecting the two inputs.
A Lipschitz function is uniformly continuous: for , choosing input tolerance works at every point. If , the function is constant. The converse fails; the square root on is uniformly continuous, and satisfies the weaker Hölder continuity bound , without a finite Lipschitz constant. These distinctions are developed in Lebl's worked examples. [ref]
The usefulness is controlled sensitivity. Successive Lipschitz maps with bounds and have a function composition with bound , because each stage amplifies the previous distance by at most its own bound. For an ordinary differential equation, Lipschitz continuity in the unknown state is the condition that makes nearby trial solutions controllably close in the Picard-Lindelöf theorem. For incomplete data, the McShane extension theorem fills in unobserved values while preserving the same bound. This one inequality connects error estimates, uniqueness, and interpolation.
For a probability density function on with Lipschitz bound , the triangular lower envelope gives . If is strictly positive everywhere, the inequality is strict. Equality forces the entire probability density function to coincide with the triangular envelope, which vanishes outside a finite interval.
Locally Lipschitz function Created 2026-09-28 Updated 2026-10-14
A function between metric spaces is locally Lipschitz if every point has a neighbourhood on which one finite Lipschitz bound works for every pair. The neighbourhood and bound may depend on the point. A continuously differentiable real function on an open interval has this property: continuity of its derivative bounds that derivative on a sufficiently small closed interval, and the mean value theorem bounds every secant slope there.
The function is locally Lipschitz at every real point but has no single bound on the real line. The square root is locally Lipschitz on , and has the bound on for . Adding zero to its domain changes the conclusion at that point: the ratios in the Lipschitz continuity example become unbounded, so it is not locally Lipschitz at zero. This distinction is what permits the delayed, nonunique ODE solutions illustrated under Picard-Lindelöf theorem.
Longest increasing subsequence Created 2026-09-28 Updated 2026-10-14
A longest increasing subsequence is an increasing subsequence of maximum length. Write that length as , with for the empty sequence; a nonempty input has . Several selections can attain the same maximum. Here uses the weak convention ; write for the maximum length of a strictly increasing subsequence. For , these lengths are three and one respectively; for an input with distinct values they agree.
For , the answer is , attained at indices , while . One useful interpretation is the smallest number of deletions needed to make the surviving sequence nondecreasing:
Indeed, keeping a longest increasing subsequence attains this bound, and any valid remaining sequence is an increasing subsequence, so cannot have more than terms. In this example the answer is . This makes a measure of how much order can be recovered without moving any observation.
A table that ends at each position. Let be the maximum length of an increasing subsequence ending specifically at position . The dynamic programming recurrence relation is
The zero covers a selection consisting only of . Otherwise its penultimate index is an eligible ; append to an optimal selection ending there. Fill entries in increasing index order. For strictly increasing subsequences, change the comparison to . The strict version and reconstruction are developed in University of Toronto, CSC373 tutorial 4 solutions (2018), exercise 2; the weak version follows by allowing equality at the append step.
In the worked input, the weak table is and the strict table is . At the second , equality extends the first in the weak table. The final entry is only one, although the optimum is four: the best increasing subsequence need not finish at the last input position. Record a maximizing predecessor whenever . Following these stored indices from any position maximizing , then reversing them, gives an actual longest increasing subsequence. For the weak example the backward chain is .
Figure 1.
Skipping positions and allowing equal values changes the optimum
. An original toy input, not measured data. The colored selection keeps indices and values . The two dynamic programming rows give the best lengths ending at every position; the backward arrows reconstruct the weak longest increasing subsequence. Details.
Scanning all earlier positions for each uses time complexity and space complexity for lengths and predecessors, using Big O notation and assuming constant-time comparisons and operations on indices.
Keep the easiest ending to extend. The faster algorithm maintains a minimum-tail table for increasing subsequences: is the smallest final value of any length- increasing subsequence in the processed prefix. For equal lengths, a smaller ending permits every future extension allowed by a larger ending. Thus only one best ending per length is needed. The table is nondecreasing, since removing the last term of a length- selection gives . Start with an empty table. On reading , use binary search to find the first entry strictly greater than : replace it by , or append if there is no such entry. Its position is one beyond the longest existing length whose ending is at most . See Liben-Nowell, Vee and Zhu, section 3.1 and Figure 1.
Duplicates determine the binary search rule: weak increase replaces the first , whereas strict increase replaces the first . In Python these positions are returned by bisect_right(T, v) and bisect_left(T, v) respectively, counting positions from zero. Replace an entry or append; do not insert and shift the remaining entries. The documented equality rules are in Python documentation, bisect_left and bisect_right. Each search takes comparisons, giving time complexity , conventionally for , and space complexity for the weak length alone.
Figure 2.
Two binary-search tie rules give different minimum-tail tables
. Original exact traces for the same toy input, not measured data. Each cell shows a tail value and the input index supplying it; the outlined cell was updated in that row. At the second , the weak algorithm appends and the strict algorithm replaces. The final weak table has length four, but its supplier indices are not in increasing order. Details.
A length certificate needs separate reconstruction. The final weak tail values are , but they do not form an increasing subsequence of this input: the zero occurs last. Each table entry certifies a selection of its own length; the entries need not come from one compatible selection. To recover a longest increasing subsequence during the fast algorithm, store a supplier index for each tail and a predecessor index for each input position. Before replacing slot , save , or no predecessor if , then set . Later replacements leave saved unchanged. Follow predecessors from the final and reverse. This uses space complexity and returns indices for the weak trace. The same construction works with the strict comparator; compare the two auxiliary arrays in CP Algorithms contributors, restoring the subsequence after binary search.
Deleting or changing one term. If deletes position , then
Deleting cannot create a longer increasing subsequence; removing position from a previously optimal selection loses at most one term. If instead changes just the value at position , both inputs have the same deleted sequence, so their lengths each lie between its length and its length plus one. Consequently . These bounds also hold for strictly increasing subsequences. In the weak example, deleting either lowers the length to three, while deleting the final zero leaves it four. This is a Lipschitz bound for single-term edits, regardless of the numerical size of a replacement. Insertion has the same bound by reversing deletion, so insertions, deletions or replacements can change by at most .
For historical context, [ref] studies the comparison count for distinct elements of a totally ordered set. Its distinctness assumption makes the weak and strict conventions coincide. No distinctness assumption is needed for the comparator-specific algorithms above.
McShane extension theorem Created 2026-10-03 Updated 2026-10-14
Let be a nonempty subset of a metric space , and let satisfy a Lipschitz bound . Then
are real-valued Lipschitz functions on all of , agree with on , and obey the same bound . Every other extension satisfying that bound lies between them, . Despite the infimum in its formula, is the largest such extension: every given sample supplies an upper constraint .
Take three real samples , , , and allow the bound . Their least Lipschitz constant is only , so this is deliberately a looser permitted bound. The two extensions are
At , the allowable interval is . The interpolant obtained by linear interpolation is a piecewise linear function and has value there. Extending it constantly outside obeys the same bound on the entire real line. At , the allowable interval is . Thus the data and the bound control possible values without selecting a unique curve.
Figure 1.
Each sample constrains a Lipschitz function; the upper and lower envelopes bound every allowed extension
. Details.
The construction is useful when data are known only on a subset: it extends them without increasing an allowed Lipschitz bound. A short justification explains why the envelopes work. Fix . The triangle inequality and the bound on imply
so the infimum is finite below; the term makes it finite above. At a sample , all upper terms are at least , while that term gives equality. Finally, gives after taking an infimum; exchanging proves the bound. The lower envelope follows by applying the same argument to .
E. J. McShane's paper Extension of range of functions appeared in the Bulletin of the American Mathematical Society, volume 40, in 1934, pp. 837–842. [ref] [ref]
Mean value theorem Created 2026-09-24 Updated 2026-10-14
The mean value theorem says that an average rate of change is attained as an instantaneous rate somewhere between the endpoints. Let and let the real-valued function be continuous on the closed interval and differentiable on the open interval . Then there exists such that
The right-hand side is the slope of the secant line joining to ; the left-hand side is the slope of the tangent line at . The derivative need not be continuous, and the function need not be differentiable at the endpoints. [ref]
For the polynomial on , the secant line has slope . Since the derivative is , the required interior point is . The tangent line there is , whereas the secant line is . Their equal slopes make them parallel, but they are distinct straight lines: the theorem equates rates, not heights.
Figure 1.
The secant line and interior tangent line to have equal slopes but different heights
. Details.
The practical strength is that the unknown point can disappear from an estimate. Under the same hypotheses, if the derivative satisfies throughout , where , then
Applying this to every subinterval proves Lipschitz continuity with Lipschitz bound . For example, on has , so an input change of size at most changes its output by at most , as long as both inputs lie in that interval. A local derivative bound therefore controls finite changes without computing an integral. The sign of the derivative similarly gives the derivative criterion for monotonicity.
Taking shows that a function with zero derivative throughout a real interval is a constant function, provided it is continuous at any included endpoints. The interval condition is essential: on the domain of a function , the function equal to zero on the left interval and one on the right interval has zero derivative everywhere. It is a locally constant function, yet not a constant function on the whole domain of a function. The mean value theorem cannot cross the gap.
A concise proof subtracts the secant line: set and . Then , and Rolle's theorem gives an interior point with . The geometric idea is to remove the average trend and find a horizontal tangent line in what remains.
Continuity on the compact rectangle gives finite constants and . The real mean value theorem in the second coordinate gives within the rectangle. Define the Picard iterates on the entire interval by
If the previous iterate stays in the vertical range of , then . Induction therefore makes all these iterates well defined on .
Repeated use of the Lipschitz bound gives the factorial estimate
The case is the direct integral bound; integrating the estimate for proves the next one, on either side of . The series of uniform bounds converges, so the iterates converge uniformly to a continuous function taking values within the closed vertical range. The Lipschitz estimate permits passage through the integral to give . The fundamental theorem of calculus now gives and . Thus the solution exists on the full stated interval; no extra restriction was used.
For the specified equation take , so . On ,
The condition holds at , namely . The rectangle avoids , so both continuity hypotheses hold there.
Direct separation gives , hence and the initial value yields . The branch through is
It remains positive on this interval. At it reaches zero, where the differential equation is undefined, so this is its maximal real interval containing zero. The rectangle theorem supplies a sufficient interval, smaller than that actual interval.
The empirical spectral measures of the two real symmetric matrices are
where is the Dirac measure at . Thus . Pair the eigenvalues in the specified increasing order and apply the triangle inequality followed by Lipschitz continuity with bound :
This deterministic estimate uses only the Lipschitz bound; no entry independence or distributional hypothesis is needed here.
A function satisfies Lipschitz continuity with bound if
Here is an admissible Lipschitz bound; the least admissible value is the Lipschitz constant. The later parts use the admissible bound .
Use the fixed common entry law from the printed setup: has mean zero and second moment for each upper-triangular entry, including the diagonal. Let
Since , the removed part after centered truncation of a Wigner matrix is
Consequently . Symmetry gives . There are diagonal terms and off-diagonal terms in this sum, so
Mirrored entries are counted twice, as they must be; independence of those mirrored entries is neither true nor needed for this expectation calculation.
By the preceding bound and the Markov inequality,
The dominated convergence theorem applies to , so . Choose with . Then
This second moment bound for spectral truncation depends only on and the common law of , and is uniform over functions with Lipschitz bound . No fourth-moment hypothesis is required. If the scaled entry law were allowed to vary arbitrarily with , a uniform choice would instead require uniform decay of its second-moment tails; the intended fixed-law setting supplies exactly that condition.
The stated bound is Lipschitz continuity with constant . For every and every , taking ensures whenever . The same works at every point, so is both continuous and uniformly continuous.
For an integer , partition into equal intervals and define a step function
At the remaining endpoint set , so the final interval may be taken closed on the right. The Lipschitz bound gives
Choosing proves the requested uniform step approximation on a compact interval:
A sufficiently fine partition gives a piecewise constant approximation uniformly over the whole interval.
The continuous function and every finite step function are Riemann integrable. Put . Integrating each constant piece explicitly gives
Since the sine differences have absolute value at most , the triangle inequality and uniform approximation give
To prove convergence, fix and first choose with . With this held fixed, the finite number is independent of , so the second term is also less than for sufficiently large . Therefore
First make the approximation error small, then let the oscillation frequency grow. This is the step-function proof of the Riemann-Lebesgue lemma; it does not require assuming that a Lipschitz function has an everywhere-defined derivative.
Let and . The Lipschitz continuity of cosine and the Cauchy-Schwarz inequality imply
The centered expectation term contributes ; omitting it would leave the Lipschitz bound incomplete. In particular has continuous sample paths on the compact cube, so its maximum exists and is measurable.
Put
Choose a Cartesian finite net whose coordinate spacings are at most , including the endpoints. Every point of the cube is within Euclidean norm distance of , and
On the event , replacing any by a nearby grid point changes by at most . Since and , this is less than . Therefore
The Markov inequality bounds the first event by . At a fixed , the summands are centered, independent and identically distributed, and have absolute value at most . The supplied Hoeffding inequality, with , bounds each grid event by
A union bound now gives
The choice of balances the cost of a large random Lipschitz constant against the covering number of the cube: . Consequently works, with
This uses only the first moment and has a constant independent of . The finite net is deterministic even though the Lipschitz constant is random.
For , the nearest neighbour distance is the th order statistic of . Each has continuous distribution function on . The probability integral transform makes independent and identically distributed random variables with the uniform distribution on . Monotonicity of gives , a uniform order statistic. Strict monotonicity is not needed at this stage.
For , counting observations below gives
Differentiating and cancelling consecutive terms gives the Beta distribution:
The Gamma function identity identifies this with the stated normalization. Ratios of Beta function integrals yield the moments
This is the probability content of a nearest neighbour ball identity, specialized to intervals on the real line.
Now write . The Lipschitz bound gives
Thus
Strict positivity of the probability density function makes continuous and strictly increasing from zero to one, so its inverse function is defined for every .
For the requested conditional calculation, suppose . At the preceding bound gives
Therefore , and substituting in the approximation proves the inverse probability content bound for a Lipschitz density:
The same argument works, without , on the meaningful local range with .
Since the nearest neighbour density estimator obeys , its conditional bound follows from the Beta distribution moments:
Hence, under the printed location condition,
The conditional inverse function bound also bounds , so the expected value in this calculation is finite under those formal hypotheses.
There is, however, a genuine flaw in the original PDF: the printed condition has no admissible points when is strictly positive on all of . A probability density function on all of cannot have Lipschitz constant zero, so . Its Lipschitz bound forces
Integrating this triangular lower envelope gives the Lipschitz density height bound
The inequality is strict because the probability density function has positive mass outside the finite interval. Thus everywhere. The last two conditional conclusions above are valid implications but vacuous as printed. Dropping strict positivity gives only , with equality forcing the entire probability density function to be the normalized triangular envelope. The local inverse bound does not justify replacing the printed condition by its reverse in the final expected value bound, since ranges over all of .
For , factorization of a difference of powers gives
Consequently the polynomial obeys the Lipschitz bound
Put . By the Cauchy-Schwarz inequality,
Interchanging and proves the Lipschitz bound
The subgradient method chooses and a step size , then sets
Assume, as the question's use of requires, that a minimizer exists, and write . Since every subgradient here has Euclidean norm at most , the standard best-iterate estimate is
Taking a suitable constant step when the target accuracy is known, or a standard diminishing sequence, gives error at most in
iterations, so the requested exponent is .