Tail probability Created 2026-10-03 Updated 2026-10-14
For a real random variable , an upper-tail probability has the form and a lower-tail probability has the form . Each is the probability of an event lying beyond a chosen threshold in one direction. A tail probability need not be small: the threshold determines how much of the probability distribution it includes. A concentration inequality bounds such probabilities, often for deviations from an expected value.
Endpoint conventions matter. Write for the cumulative distribution function and . The complement rule of probability gives four distinct formulas:The strict upper-tail convention is the survival function . Its value differs from the inclusive upper tail probability by exactly the probability mass at the threshold:A singleton with positive probability mass is an atom of a measure. Thus excludes an atom of a measure at , whereas includes it. These endpoint identities follow directly from the cumulative distribution function properties in Kyle Siegrist, Distribution and Quantile Functions: endpoint probabilities and right tails.
As the threshold increases, both upper tail probabilities are nonincreasing functions. The strict survival function is a right-continuous function; the inclusive upper tail probability takes the upper endpoint value at a downward jump, equal to the left limit of the survival function. Both tend to zero as for a real random variable, but the speed of that decay differs across probability distributions. The cumulative distribution function properties and their proof from continuity of probability measures are given in MIT 6.436J, Lecture 4: random variables and cumulative distribution function properties.
For a fair six-sided die , the discrete uniform distribution assigns probability mass to each of . At threshold four,Between four and five, both upper tail probabilities equal . At the largest possible outcome the distinction is especially visible: , but . The diagram shows exact probabilities for this mathematical model; its dots specify which endpoints belong to each step function.
If a probability distribution has a probability density function , then every singleton has zero probability mass andFor an exponential distribution of rate two, for and zero otherwise, so for and for . Hence . This tail probability is an integral of the probability density function, not its height . A mixed probability distribution retains endpoint jumps even with a smooth component: give zero probability mass and choose this exponential distribution with probability . Then , , and for .
A two-sided tail probability can measure the absolute value of displacement from a specified center . For , the two extreme events are disjoint events, soFor strict displacement , replace the last expression by . The condition prevents overlap; at adding inclusive tails double-counts any probability mass at . For a uniform distribution on , take and : the two tail probabilities are each and their sum is . Equal tails follow from this symmetric probability distribution, not from the phrase two-sided alone; for a uniform distribution on with , the two tail probabilities are zero and .
The tail-sum formula for expectation turns a whole curve of tail probabilities into an expected value. For any nonnegative random variable , without assuming a probability density function or a finite expected value,For a proof outline, write pointwise and exchange the expected value and Lebesgue integral using Tonelli theorem; is an indicator function. The inclusive version has the same Lebesgue integral: positive probability masses occur at only a countable set of thresholds, which has Lebesgue measure zero. For a nonnegative integer-valued random variable , the tail-sum formula instead gives . The integer hypothesis is essential for these sums. The integral identity, its indicator function proof, and the integer version appear in Kyle Siegrist, Additional Properties of Expected Value: integration and summation of right tails.
For the fair die, this tail-sum formula yields , equal to the direct weighted arithmetic mean . For the rate-two exponential distribution, the area under the survival function is , its expected value. The first panel below shades an integral of the probability density function for a single threshold; the second shades an integral of the survival function across all nonnegative thresholds. These are analytical illustrations, with the displayed curves truncated at three; their exact total areas use an infinite integration range.
Nonnegativity is essential to interpreting the upper tail probability area as : for a general real random variable that area equals the expected value of its positive part. An integrable random variable satisfies , subtracting the expected value of its negative part; infinite terms cannot be canceled. Even when is finite almost surely, its expected value can be infinite. For the shape-one Pareto distribution on , on and for , so the area is . The finite versus infinite expected value distinction is illustrated in Kyle Siegrist, Definitions and Basic Properties: exponential and Pareto expected values.
Why are tail probabilities useful? They answer threshold questions directly, and a concentration inequality can bound them without knowing the full probability distribution. For nonnegative with finite expected value, Markov inequality gives for : a large threshold relative to the expected value forces rarity. The quantile function reverses the question by choosing a threshold for a prescribed cumulative level. If with , then ; an atom of a measure may prevent equality. For the die, , with strict upper tail probability zero and inclusive upper tail probability .
A tail probability describes rarity under a specified probability distribution; it is not automatically a conditional probability after extra information. For with ,because the threshold events are nested. Thus the die has but . Conditioning changes the sample space and renormalizes its probability measure; the same extreme outcomes can become common in that restricted population.
Tiny-pivot roundoff in Gaussian elimination 2026-10-18
A nonzero pivot element can still be a poor numerical choice. Partial pivoting bounds the absolute values of the elimination multipliers by one in exact arithmetic, because each numerator is no larger than the selected denominator. This usually improves numerical stability, but does not prevent every possible growth of intermediate entries or guarantee accurate answers for every linear system.[ref]
2.6 Row pivoting. Fundamentals of Numerical Computation by Tobin A. Driscoll and others; §2.6.4, Example 2.6.6, equation (2.6.3) and concluding discussion: small-pivot instability and the limits of pivoting
To see the mechanism without depending on hardware, define a toy floating-point arithmetic model. The operator rounds an exact real number to the nearest value with three significant decimal digits; halfway cases choose the even final digit, and . Allow an unbounded exponent range. Round the inputs and the result of every addition, subtraction, multiplication and division separately; a product followed by a subtraction rounds twice. This is a prescribed arithmetic model, not a measurement of a physical computer. All inputs in the following original example are represented exactly:Without a row interchange, the elimination multiplier is . The last coefficient and right-hand side becomeTwo distinct exact values now have the same rounded representation. Back substitution therefore returnsThe small difference carrying information about was lost during elimination; the final subtraction only exposes that loss. Dividing by the tiny pivot element amplifies sensitivity to the lost information.
With partial pivoting, interchange the two rows, including their right-hand sides, to start from . Now , and the rounded updates areBack substitution gives and . Both paths round intermediate values, but only the first creates million-sized entries and then divides a lost difference by .
The true solution follows from the original second equation :Evaluate the linear-system residual against the original data in exact arithmetic, separately from the three-digit solve. With , the maximum norm, the results areThe respective relative linear-system residuals are and . Computing the diagnostic in higher precision matters: a check made only against the rounded reduced equations would miss the original error.
The same three-digit floating-point arithmetic model gives without a row interchange and with partial pivoting; exact linear-system residuals expose the difference
. Details. This matrix is well conditioned in the maximum norm: its induced matrix norm is , whileThe failure therefore belongs to this unpivoted algorithm, rather than a large condition number. In general, however, partial pivoting cannot remove sensitivity inherent in the data. For any approximate solution of an invertible matrix system, ; the induced matrix norm inequality and giveA small linear-system residual controls solution error only in conjunction with the condition number; numerical stability and sensitivity are different questions.[ref]
Total variation of a function Created 2026-09-24 Updated 2026-10-18
The total variation of a function measures its accumulated rises and falls, rather than just its change between the endpoints. For each partition of an interval , add the absolute values of its sampled increments. Then take the supremum over all such partitions of an interval:The function has bounded variation when . This definition uses its value at every point of the interval, including both endpoints.[ref]
Real Analysis Lecture Notes: 3.5 Functions of Bounded Variation by Christopher E. Heil. §3.5.1, Definition 1, printed pp. 1–2: partition definition and pointwise convention
For a nondecreasing function, all increments are nonnegative and the sum telescopes to . More generally, the triangle inequality gives . Equality can fail dramatically when the function changes direction: an object can travel a long distance and finish near its starting position. Here we measure movement of the function's value; arc length of its function graph also includes horizontal movement.
Trace and local volume change Created 2026-10-14 Updated 2026-10-20
For any fixed real -by- matrix , as the real parameter tends to zero,The big O notation means the remainder is bounded in absolute value by for some constant near zero. The determinant stays positive for sufficiently small , so its oriented volume factor is also its ordinary volume factor. Thus the trace is the first-order fractional volume change, measured from the identity matrix.
A proof follows directly from multilinearity of the determinant. Each column of is . The constant term chooses all the standard basis columns and equals one. A term containing exactly one factor replaces just column by ; expanding that vector in the standard basis leaves only its component, , because every other choice repeats a column. Summing gives . Terms with two or more replacements have order or higher. This also proves the derivative of the determinant at the identity matrix.
This coefficient has a direct visual meaning. At the point , the linear map has component along direction . In a small step , these are the first-order changes of the square's or box's sides in their own directions. Summing them gives its fractional area or volume change; the off-diagonal entries initially change shape rather than contributing to this first-order total.
For the constant-coefficient linear system of differential equations , the exact linear flow is , using the matrix exponential. Its volume factor isThis is the matrix exponential determinant identity. One can derive it without diagonalization: set , whose matrix inverse is , and use in Jacobi's formula to get . The scalar differential equation with initial value one gives the displayed exponential function. Thus positive trace causes volume expansion, negative trace causes contraction, and zero trace preserves volume, even when individual directions behave differently.
In two dimensions, compare four generators at :The first and third diagonal matrices expand or contract both directions. The second expands horizontally and contracts vertically by reciprocal factors, making a rectangle of unchanged area. For the last nilpotent matrix, , so its matrix exponential is exactly ; it sends to , a shear mapping. Zero trace allows substantial shape change and does not mean the flow map is stationary.
Four examples of a linear system of differential equations: trace controls area change while a saddle and a shear mapping preserve area
. Details. The first-order statement and the exact flow map should be distinguished. For , , whereas for all real . Zero trace eliminates the first-order change in the approximate step, and it preserves volume exactly in the matrix exponential flow. The examples use an abstract parameter and coordinate vectors; no physical units are assumed.
Truncation toward zero 2026-10-14
Truncation toward zero removes the fractional magnitude of a real number, giving the integer obtained by applying the floor function to its absolute value and restoring the original sign; a magnitude below one gives zero. More precisely,The result is zero for . For example, and , whereas . Python's
math.trunc uses this towards-zero convention, so replacing it by math.floor changes calculations with negative noninteger inputs. [ref]https://docs.python.org/3.14/library/math.html#math.trunc. Python 3.14 math.trunc documentation: floor on positive inputs, ceiling on negative inputs
.Truncation toward zero is symmetric in sign, while the fractional part defined by the floor function is always nonnegative
. Left: exact integer endpoint values distinguish the two sign-dependent truncation rules; a whole neighborhood of zero maps to zero. Right: takes the sign of a noninteger input, while lies in on both sides of zero. Open endpoints show excluded limiting values. Details.For every real number ,The discarded difference has the sign of when is noninteger. In contrast, the fractional part is always in . At , these two differences are and . Thus specifying a signed fractional remainder requires specifying which integer-valued operation is used.
Unlike the floor function and ceiling function, truncation toward zero need not commute with adding an integer. At and , , whereas . This matters if negative coordinates are assigned to equal-width bins by converting a quotient to an integer: belongs to the bin under the floor function, but truncation gives zero. The appropriate operation follows from the declared bin intervals.
Truncation toward zero is a nondecreasing function with a discontinuity of a function at each nonzero integer. It has no discontinuity of a function at zero, because it is identically zero on . Its agreement with the floor function on the positive side and the ceiling function on the negative side explains the different closed endpoints in the diagram.
Twin-prime upper bound using Bombieri–Vinogradov Created 2026-10-06 Updated 2026-10-14
Apply the Selberg upper-bound sieve to the numbers with prime. For odd squarefree integers , the local count is and the density is . With sieve level , the normalizing sum is by the truncated Euler-product lower bound. The Selberg least-common-multiple weights have absolute values at most . The weighted arithmetic-progression error bound and Bombieri–Vinogradov theorem make their total error . Consequently the number of twin prime pairs with smaller member at most is .
Two-by-two positive-definiteness test 2026-10-14
For a real symmetric matrix , completing the square gives, when ,Thus is a positive-definite matrix exactly when and . For necessity, test first, then ; for sufficiency, the displayed two positive squares give the result. These are the first two leading principal minors in Sylvester's criterion. A positive determinant alone is insufficient: has determinant but is a negative-definite matrix.
The eigenvalues provide an equivalent test under the same real-symmetric hypothesis:The spectral theorem for real symmetric matrices supplies coordinates in an orthonormal basis in which . More generally, a complex Hermitian matrix has an orthonormal eigenbasis and , so it is a Hermitian positive-definite matrix exactly when every eigenvalue is positive. This is a short proof outline: test the eigenvectors for necessity, and sum the positive squared absolute values for sufficiency.[ref]
Convex Optimization by Stephen Boyd and Lieven Vandenberghe. Appendix A.5.2, pp. 646–647: symmetric eigenvalue decomposition and definiteness
For a real positive semidefinite matrix, the condition is instead for all vectors, equivalent here to , , and . If , the same completing the square proves this; if , nonnegativity forces and leaves with . Merely replacing the strict inequalities on the leading principal minors by nonstrict ones fails: has both leading principal minors zero yet gives . An indefinite quadratic form takes both positive and negative values; its real symmetric matrix has eigenvalues of both signs.
Two-flavour vacuum survival model 2026-10-18
For a deliberately simplified neutrino oscillation calculation, take two neutrino flavors related to two mass eigenstates by a real rotation matrix with angle . A quantum superposition acquires different phases during propagation; projecting back onto the initial neutrino flavor gives the probabilityHere is path length and is neutrino energy; the numerical coefficient incorporates unit conversion.
The path dependence has a geometrical origin. In an original spherical-Earth model, let be the radius and a fixed production height, neglecting detector depth. Let be the zenith distance of the direction in the sky from which the neutrino arrives, so means downward propagation. The backward ray from detector to production obeys . Its positive solution isThus and . The calculation explains why opposite directions test very different baselines, rather than attributing every observed direction to the same travel distance. Actual production heights and the angle between the outgoing charged lepton and incoming neutrino smear that relationship.
For an original chosen example, set and . At , gives , while gives . The first minimum is at . These are stipulated inputs, not a fit to the 1998 data. A broad distribution of true , together with energy and directional uncertainty, smooths the sharp minima.
A direct amplitude check makes the mechanism explicit. DefineThen . Taking its squared absolute value yields the displayed survival formula because . Unitarity gives : disappearance from one channel becomes conversion to the other within this closed model.
This illustration does not describe all solar neutrino propagation. Coherent forward scattering in matter changes the effective propagation operator, and three active neutrino flavors require a larger mixing description. Even in the simplified model, neutrino oscillation measures a squared-mass difference; it does not determine the absolute neutrino mass.
Uniform absolute convergence 2026-10-25
A series of functions is uniformly absolutely convergent on a set if the series of their absolute values has uniform convergence there. A sufficient condition is the Weierstrass M-test: if for every and , then the tail is bounded uniformly by . This also proves uniform convergence of the original series by the Uniform Cauchy criterion.
Uniform convergence Created 2026-09-24 Updated 2026-10-14
A sequence of functions converges uniformly to , where is a metric space with metric , precisely whenFor real numbers, use the absolute value . Compare the universal quantification and existential quantification:The decisive change is whether can depend on . Uniform convergence implies pointwise convergence.[ref]
6.1 Pointwise and uniform convergence. Basic Analysis: Introduction to Real Analysis, Volume I by Jiří Lebl, §6.1.2, Definition 6.1.6 and Proposition 6.1.7
For functions taking values in real numbers on a nonempty domain of a function, the supremum error is , allowing . Then uniform convergence is equivalent to . The supremum need not be a maximum: pointwise strict bounds below only give , so use tolerance when proving this equivalence. This single error bound controls every possible input, including one chosen after seeing the index.
For and its pointwise limit on , the error is zero at one but approaches one as from below. Consequentlyfor every positive integer . This supremum is never attained: below one the error is , and at one it is zero. Deleting the endpoint leaves the same supremum error on . To disprove uniform convergence directly, choose : for any proposed , take and . The error equals , violating the strict tolerance. Thus a moving input defeats every proposed common threshold.
On the smaller interval , for a fixed , the pointwise limit is zero andFor and , the exact first successful common threshold isThe logarithm and floor function turn an infinite approximation statement into a finite stopping rule. At , fails tolerance , while succeeds. At and , the ratio is exactly three: is necessary because equality is insufficient. For , every error is zero. The domain of a function determines whether one threshold can certify every input.
For another explicit stopping rule, let on . Its uniform limit is zero and its supremum error is . For every , works, using the ceiling function. Unlike on , it controls even the endpoint.
The practical beauty of uniform convergence is that one quantitative bound can survive further operations: the uniform limit theorem preserves continuity, and uniform convergence preserves integrals on a compact interval controls accumulated error. Differentiation needs additional hypotheses, such as uniform derivative convergence with an anchored value. These results distinguish an approximation that looks accurate at selected inputs from one that justifies replacing a whole function in a calculation.
If real polynomials converge by uniform convergence to on all of the real line, then for some and constants , for every , with convergent. Indeed, a common uniform error below one gives everywhere. A bounded polynomial on the real line is constant, since every nonconstant polynomial grows in absolute value at infinity. Evaluating at zero identifies the limit of a sequence of constants, so is a polynomial. This conclusion depends on the entire real line being the domain.
Uniformly continuous function Created 2026-09-24 Updated 2026-10-18
A uniformly continuous function has one input tolerance valid throughout its domain of a function. For , with , uniform continuity meansChoose the output tolerance first, then a positive valid for every pair of function inputs. It may depend on , the function and its domain of a function, but not on the pair’s location. The absolute values measure input and output distance.[ref]
Basic Analysis: Introduction to Real Analysis, Volume I by Jiří Lebl. §3.4, Definition 3.4.1: a single positive input tolerance for all pairs in the specified real domain
Compare the quantifier order with the epsilon-delta definition of continuity:Both lines end with . In the first, can depend on the point ; in the second, it is chosen before . Thus uniform continuity implies continuity at every point. Each requested gets its own shared tolerance.
For an exact example, take the polynomial function on the closed interval . For every pair of function inputs in that interval, polynomial factorization givesConsequently works everywhere on this domain of a function. With , the common tolerance is . Near the right endpoint, for example, and have input distance and output distance . The bound is sufficient; it does not claim the largest admissible input window at each point.
On the whole real line, the same polynomial function is a continuous function but fails uniform continuity. Take the sequences and , for positive integers . ThenFor any proposed , choose an integer . The inputs are closer than , yet their outputs violate the fixed tolerance . The sequences need not themselves have a finite limit: their mutual distance is what tends to zero. This is the obstruction captured by the sequential criterion for uniform continuity. Restricting the domain of a function to removes these escaping pairs.
A uniformly continuous function need not be a bounded function. The identity function on the real line has , so always works, although its image of a function is the unbounded real line. Uniform continuity controls changes between nearby inputs, not the overall size of outputs. Likewise, an unbounded domain of a function does not by itself prevent uniform continuity.
The square root supplies a different common tolerance on the interval . Assuming , put and . Since ,Interchanging the inputs when necessary provesThus guarantees uniform continuity on the entire domain of a function, including zero. For , any input distance below suffices. The pairs and both have input distance ; their output distances are respectively and . The common guarantee accommodates quite different local sensitivities.
This Hölder continuity bound allows a curved tolerance rule. It is weaker than a Lipschitz bound: at zero the output change divided by the input change isNo finite Lipschitz constant works near zero, even though uniform continuity does. A Lipschitz function does have uniform continuity, choosing when its Lipschitz bound is positive; when it is a constant function.[ref]
Basic Analysis: Introduction to Real Analysis, Volume I by Jiří Lebl. §3.4, Proposition 3.4.8 and Example 3.4.10: Lipschitz continuity implies uniform continuity; the square root on the nonnegative half-line separates the properties
Square-root input changes share an output tolerance even though amplification near zero is unbounded
. At left, the exact output changes for base points stay inside whenever and . The right panel computes the amplification for inputs : it grows without bound as decreases. These are calculated function graphs, with no experimental measurements. Details.For general metric spaces, replace the absolute values by the respective distance functions. The Heine-Cantor theorem gives an existence guarantee: every continuous function on a compact metric space is uniformly continuous. In particular, continuity on a finite closed interval provides a common tolerance, even when no simple formula for it is known.[ref]
Basic Analysis: Introduction to Real Analysis, Volume I by Jiří Lebl. §7.5, Definition 7.5.10 and Theorem 7.5.11: uniform continuity between metric spaces and the compact-domain theorem
For a short proof outline, fix . Continuity gives each point an open ball of radius within which outputs differ from by less than . The open balls of half these radii still cover the domain of a function. Compactness supplies a finite subcover. Take to be the smallest half-radius in this finite set. Two inputs closer than lie together in one of the original open balls, so the triangle inequality bounds their output distance by . The beautiful step is that the compact set turns local choices into finitely many choices, whose minimum stays positive.
A shared tolerance also makes uniformly continuous functions preserve Cauchy sequences: after choosing for , all sufficiently late input pairs are closer than , so all corresponding output pairs are closer than . Unlike a convergent sequence argument, this does not require an input limit inside the domain of a function. It is why uniform continuity is useful for extending a function toward missing endpoints and for the decay argument below.
For each positive integer , put on . Its supremum norm is exactly , so this sequence of functions converges to zero by uniform convergence. Nevertheless,Each of its complete sine oscillations contributes : rise from zero to , fall through zero to , then return to zero. Taking a partition of an interval through all extrema attains . Every further partition refinement merely subdivides monotone function segments, so the same reasoning as in partition example of total variation proves the upper bound too.
The functions sin(2πnt)/n converge uniformly to zero while their total variation remains 4; all three function plots use the same vertical scale
. Details. For a continuously differentiable function on a closed bounded interval, total variation also satisfiesApplied here, the derivative is , and integrating its absolute value over periods gives . The differentiability hypothesis matters: the partition definition applies much more widely than this derivative formula.[ref]
1 Algebraic and Analytic Methods. NIST Digital Library of Mathematical Functions; §1.4(v), equations 1.4.33–1.4.34, Functions of Bounded Variation
Small pointwise size and small accumulated movement are different approximation goals. Unit from norm one or minus one Created 2026-09-24 Updated 2026-10-14
For a number field and an algebraic integer , the criterion isHere the absolute field norm means the field norm down to ; its absolute value is one. Necessity follows from with both factors integers. Conversely, multiplication by on an integral basis is a matrix with integer entries and determinant . Its inverse also has integer entries, and applying that inverse to gives . The integrality hypothesis matters: has field norm one, but is not in .
In , the criterion becomes . Thus and are again algebraic integers. These units produce infinite families of solutions to the Pell equation.
Units of Q of square root two Created 2026-09-29 Updated 2026-10-14
The unit has field norm minus one and is the least unit greater than one in the field embedding sending to its positive value. It is a fundamental unit. The Dirichlet unit theorem therefore gives
Writing , direct multiplication givesFor , the pairs are , andIn particular, has field norm one. Its powers start , , , , and give solutions of the Pell equation . This turns finding one unit into generating infinitely many exact integer solutions.
The two field embeddings show a striking balance:For positive , one value grows while the other approaches zero, and their product stays . Taking logarithms of their absolute values converts this multiplication into equally spaced points, the simplest example of the logarithmic embedding of number field units.[ref]
https://www.jmilne.org/math/CourseNotes/ANT.pdf. Milne, Algebraic Number Theory, Chapter 5, the unit theorem
Weierstrass approximation theorem Created 2026-09-24 Updated 2026-10-14
Every continuous real-valued function on a compact interval can be approximated by polynomials with arbitrarily small error everywhere on the interval. More precisely, if and is continuous, then for every there is a polynomial withThe error is measured in the supremum norm, so one approximation works at every point. The degenerate interval needs only a constant function. A change of variable reduces the nondegenerate case to .[ref]
The Weierstrass approximation theorem (Georgia Tech handout). The Weierstrass approximation theorem, Theorem 0.3, printed p. 2: uniform polynomial approximation on the unit interval
This is useful because a polynomial is described by finitely many coefficients and can be evaluated with addition and multiplication. Its surprise is that the target need not be differentiable: the sharp corner of an absolute value function can be approximated by smooth polynomials. The Bernstein approximation of a corner below makes this visible. Approximating values, however, does not by itself approximate derivatives; Weierstrass approximation does not preserve derivatives gives a counterexample.









