Tail of a sequence 2026-10-14
A tail of a sequence consists of its terms from some index onward, retaining their order and repetitions. Discarding finitely many initial terms does not change its limit of a sequence or whether it is a Cauchy sequence. A tail can also be considered as the set of values when forming an infimum, supremum, or tail diameter of a sequence; that set alone forgets the original order and repetitions.
Total variation distance Created 2026-09-24 Updated 2026-10-13
Total variation distance asks how much two probability distributions can disagree about the same event. For probability measures on one measurable space , its definition isThe supremum ranges over all measurable sets, so guarantees that every yes-or-no prediction has probability error at most . This metric takes values between zero and one; it is zero exactly when the two probability measures agree. This makes it useful for comparing a sampling algorithm's output with its target probability distribution, and for defining the mixing time of a Markov chain.
On a finite set, add the excess probability mass wherever exceeds . That excess is also half the sum of all absolute differences:The last expression reveals the common probability mass that the two probability distributions can share.[ref]
Markov Chains and Mixing Times, second edition by David A. Levin and others. §4.1, Proposition 4.2 and Remark 4.3, printed p. 48; §4.2, equation (4.13), printed p. 51
The coupling characterization of total variation distance turns this overlap into an actual joint construction; minimum sum of errors in a simple hypothesis test gives it a statistical interpretation. One quantity connects probability bookkeeping, comparison of sampling methods, and the limits of a statistical test. Total variation of a function Created 2026-09-24 Updated 2026-10-18
The total variation of a function measures its accumulated rises and falls, rather than just its change between the endpoints. For each partition of an interval , add the absolute values of its sampled increments. Then take the supremum over all such partitions of an interval:The function has bounded variation when . This definition uses its value at every point of the interval, including both endpoints.[ref]
Real Analysis Lecture Notes: 3.5 Functions of Bounded Variation by Christopher E. Heil. §3.5.1, Definition 1, printed pp. 1–2: partition definition and pointwise convention
For a nondecreasing function, all increments are nonnegative and the sum telescopes to . More generally, the triangle inequality gives . Equality can fail dramatically when the function changes direction: an object can travel a long distance and finish near its starting position. Here we measure movement of the function's value; arc length of its function graph also includes horizontal movement.
Total-variation process 2026-09-24
For a path of finite variation, its total-variation process iswhere the supremum is over every partition of an interval of . It is an increasing process, and the signed measure satisfies .
Uniform convergence Created 2026-09-24 Updated 2026-10-14
A sequence of functions converges uniformly to , where is a metric space with metric , precisely whenFor real numbers, use the absolute value . Compare the universal quantification and existential quantification:The decisive change is whether can depend on . Uniform convergence implies pointwise convergence.[ref]
6.1 Pointwise and uniform convergence. Basic Analysis: Introduction to Real Analysis, Volume I by Jiří Lebl, §6.1.2, Definition 6.1.6 and Proposition 6.1.7
For functions taking values in real numbers on a nonempty domain of a function, the supremum error is , allowing . Then uniform convergence is equivalent to . The supremum need not be a maximum: pointwise strict bounds below only give , so use tolerance when proving this equivalence. This single error bound controls every possible input, including one chosen after seeing the index.
For and its pointwise limit on , the error is zero at one but approaches one as from below. Consequentlyfor every positive integer . This supremum is never attained: below one the error is , and at one it is zero. Deleting the endpoint leaves the same supremum error on . To disprove uniform convergence directly, choose : for any proposed , take and . The error equals , violating the strict tolerance. Thus a moving input defeats every proposed common threshold.
On the smaller interval , for a fixed , the pointwise limit is zero andFor and , the exact first successful common threshold isThe logarithm and floor function turn an infinite approximation statement into a finite stopping rule. At , fails tolerance , while succeeds. At and , the ratio is exactly three: is necessary because equality is insufficient. For , every error is zero. The domain of a function determines whether one threshold can certify every input.
For another explicit stopping rule, let on . Its uniform limit is zero and its supremum error is . For every , works, using the ceiling function. Unlike on , it controls even the endpoint.
The practical beauty of uniform convergence is that one quantitative bound can survive further operations: the uniform limit theorem preserves continuity, and uniform convergence preserves integrals on a compact interval controls accumulated error. Differentiation needs additional hypotheses, such as uniform derivative convergence with an anchored value. These results distinguish an approximation that looks accurate at selected inputs from one that justifies replacing a whole function in a calculation.
Upper Darboux sum Created 2026-09-29 Updated 2026-10-07
For a bounded function and a partition of an interval , the upper Darboux sum multiplies the supremum of on each subinterval by its length and adds the results.
Value function Created 2026-09-24 Updated 2026-10-14
A value function assigns each dynamic programming state and time the best objective function value attainable over the remaining decisions. It is a score, whereas a control policy specifies the actions producing that score. In the 0-1 knapsack problem above, is the score, and choosing the items of weights and attains it. In sequential mathematical optimization, the Bellman equation computes a value function by comparing immediate reward plus continuation value. Use a supremum or infimum when the best score need not be attained by any admissible control policy.
Weak minimax inequality 2026-10-25
For a nonempty bounded array of real numbers, each column infimum is at most every row supremum, because for all . Taking the supremum over columns and then the infimum over rows proves the displayed inequality. Equality need not hold: for on positive integer indices, every column infimum is zero and every row supremum is one. This elementary bound is the order-theoretic starting point for stronger minimax theorems with additional hypotheses.
