Enumerate the rational points of a compact nondegenerate interval as . Each singleton indicator function is Riemann integrable with integral zero. Their pointwise supremum is the Dirichlet function, which is not Riemann integrable. Thus even a uniformly bounded countable supremum need not preserve integrability.
Poisson arrivals see time averages Created 2026-09-24 Updated 2026-10-14
Poisson arrivals see time averages says that an exogenous, homogeneous Poisson process samples prearrival states with the same long-run frequencies as observation over time, provided the observed system cannot anticipate future arrivals and the relevant time averages exist. The system may depend on all past arrivals: an ordinary queue does. The required independence is between future increments of the Poisson process and the history available to the system, including its service information. Assume measurable state observations with ordinary piecewise continuous functions as sample paths; write for the state immediately before time .
For a state set , let count offered arrivals by time and let be their times. With a positive finite constant arrival rate, the PASTA equality is
almost surely when the time limit exists. The indicator functions count visits on the left and time spent on the right. For a stationary process with ergodicity, the right side is the stationary probability of . It matters that the arriving customer has not yet changed the observed state.
In the M/M/1 utilization and delay example, server utilization is . Thus PASTA says that 80 percent of offered arrivals find the server busy and 20 percent find the whole queue empty. If an offered arrival seeing population is admitted with conditional probability , using fresh randomness independent of that state, the accepted fraction is , where is the stationary distribution. Multiplying this fraction by the offered rate gives the admitted queue throughput when every admitted customer eventually completes service. Accepted arrivals are selected by state and need not themselves form a Poisson process or see the unconditioned time frequencies.
Arbitrary arrivals need not see time averages. Suppose a customer arrives every two minutes and its service time is exactly one minute, with one server and no other customers. The server is busy half the time, but every arrival finds it idle. A uniformly random initial phase can even make the occupancy a stationary process, without repairing the disagreement. Nevertheless Little's law still gives , with rate measured in customers per minute. This separates Little's law from PASTA.
Ronald W. Wolff's 1982 paper gave a general PASTA theorem under nonanticipation, rather than requiring the observed system to be independent of its driving Poisson process. Its Theorem 1 compares the two long-run fractions; stationarity is a way to establish convergence, not the central sampling condition. [ref]. [ref].
Poisson thinning Created 2026-09-24 Updated 2026-10-14
Poisson thinning splits a Poisson process by independently marking each arrival as retained or rejected. Let the original Homogeneous Poisson process have rate , and let be a deterministic measurable function of time. Attach independent uniform distributions on , independent of the entire original Poisson process. At arrival time , retain the arrival if . Given all arrival times, these decisions are independent and have the specified retention probabilities. Define the two counting processes using an indicator function:
The Poisson thinning theorem gives independent retained and rejected Inhomogeneous Poisson processes. Their rates are and , respectively, in the sense of the intensity function of a point process. In particular, for ,
The independence is of the two whole processes: every finite collection of retained counts is independent of every finite collection of rejected counts. It is not merely zero covariance for one interval. For constant , the streams are Homogeneous Poisson processes of rates and ; the endpoints include the identically zero stream.[ref]
For an exact toy calculation, take per minute and retain with on and on . In the first two minutes, the retained and rejected expected values are and . In the next two minutes they are and . Over all four minutes, are independent Poisson distributions with mean each, and their sum has mean . Thus
These probabilities and expected values describe the model, not empirical measurements. In the diagram, the original nine synthetic arrivals split into five retained and four rejected arrivals; those realized counts need not equal their expected values.
Figure 1.
Independent marks split a synthetic Poisson arrival path, with exact expected counts for two time-dependent retention probabilities
. Details.
The mechanism explains why mutually exclusive labels can yield independent counts: randomness of the original total offsets the dependence from allocating a fixed total. For constant and an interval with original mean , the conditional retained count has a binomial distribution given . The joint probability generating function is
This factorization proves the two independent Poisson distributions; disjoint original intervals give independent pairs. For varying , the Independent marking theorem for Poisson point processes gives the same conclusion with the two integrated intensities. The joint red and green Poisson count formula gives the corresponding direct calculation with probability mass functions.
Independence here is unconditional. After conditioning on , the identity gives covariance for constant . Thus the retained and rejected counts are dependent for and , even though their unconditional covariance is zero. Poisson thinning can model independent routing of arrivals, or independent detection of arrivals with a known efficiency schedule; using only a retention fraction without checking the marking mechanism can give a wrong count law.
Private-witness diagonalization for incomparable enumerable sets Created 2026-10-05 Updated 2026-10-06
To prevent a Turing functional from computing the indicator function of an enumerated set , reserve a permanently unique fresh witness . On observing a convergent computation with oracle use , enumerate into if the answer is zero; otherwise keep it out. Restrain subsequent lower-priority enumerations into below . Higher-priority actions may initialize this strategy and retire its witness, but witnesses are never reused. In a finite-injury priority construction, mathematical induction on priority shows that the final computation, if observed, remains correct as a computation from the final oracle and disagrees with at . If no computation is ever observed after the final initialization, the final oracle computation diverges, since any convergent computation uses only finitely many eventually stable oracle bits.
Quadrature error Created 2026-10-06 Updated 2026-10-14
The difference between a weighted integral and a discrete approximation is a quadrature error. For a Hölder continuous function on a partition of an interval with mesh , a left endpoint approximation has error of order . For a normalized window indicator function, only the two endpoint cells contribute and the error is bounded by a constant times .
For a radial weight with the required absolutely integrable moments, rotational symmetry makes the second and fourth moments isotropic tensors. The second moment is ; its trace gives . Complete symmetry of the fourth moment forces equal coefficients of the three Kronecker delta pairings. Its double tensor contraction gives , proving the displayed expression. Odd moments vanish under . Choosing to be the indicator function of a spherical shell gives all the corresponding shell moments without separate angular integrations.
Relative perimeter 2026-10-07
The total variation seminorm of the indicator function within an open set counts only its interior interface. The perimeter of a zero extension may add a boundary contribution.
Ring of functions 2026-10-25
For a commutative ring and a set , the set of all functions is a commutative ring under pointwise addition and multiplication. It is the direct product of rings with one copy of for each .
If is a field and is finite, every ideal is generated by some of the singleton indicator functions . Indeed, whenever in the ideal has , multiplication by puts in the ideal. Every function in that ideal is a finite sum of its coordinate multiples of these .
If is infinite and is a nonzero commutative ring, the functions with finite support form an ideal without a finite generating set of an ideal. A finite collection of such functions vanishes outside one finite subset, as does the ideal it generates, whereas a singleton indicator function outside that subset belongs to the ideal of all finitely supported functions. Thus, for a field , is a Noetherian ring exactly when is finite.
For real coefficients supported on permitted divisors up to , put . Then is an upper bound for the indicator function of numbers free of the forbidden prime factors. Its support has . If the coefficients vanish on non-squarefree integers and satisfy , then : each prime factor of occurs in , in , or in both.
The indicator function example reaches a squared L2 norm ratio of two. To approach four, concentrate more strongly near zero. For , use the measurable function
All integrals use Lebesgue measure . Keeping both portions of the squared L2 norm gives
Consequently,
Every allowed member has ratio strictly below four. For any proposed constant , a sufficiently large has ratio greater than . Combined with Hardy's integral inequality, this proves that four is the smallest possible squared L2 norm constant.[ref]
The endpoint is excluded: at , , and the inner portion of also diverges. Its tail still has finite integral four. There is no finite L2 norm ratio at this endpoint, hence no equality example obtained by substituting it. The limit four is unattained by this family. Multiplying each by makes its L2 norm one without changing the ratio.
Figure 1. . Dashed input curves and solid Hardy operator averages show three allowed exponents. The right panel splits the exact squared L2 norm ratio into inner and tail contributions. The hollow endpoint marks a limit, not an admissible function in L2 space. Details.
Simple random walk on the integer line Created 2026-09-24 Updated 2026-10-14
A simple random walk on the integer line starts at and takes independent and identically distributed random variables as unit increments, with
The simple symmetric random walk has ; a biased random walk has . At or every step is deterministic, giving or respectively.
Count the rightward steps using indicator functions:
Thus the endpoint is a shifted and rescaled random variable with a binomial distribution. For a worked example, at the endpoint means exactly three rightward steps and one leftward step. There are possible orders, so its probability is , equal to in the fair case. More generally the binomial coefficient counts the orders, giving the exact probability mass function
In particular, the endpoint must have the same integer parity as : . For the support of a probability distribution is exactly . At only even integers in are reachable; at only odd integers are reachable. This restriction is easy to lose if one draws a smooth curve instead of discrete probability masses. The fair-walk counting argument is also presented in Grinstead and Snell, Introduction to Probability, section 12.1.
Figure 1.
Exact binomial endpoint probabilities for fair walks of 20 and 80 steps and a biased walk of 80 steps; only even endpoints are possible.
Details.
The endpoint identity and the binomial distribution give the expected value, variance, and standard deviation
A short direct check gives and , hence . Then apply linearity of expectation and the variance of a sum of independent random variables.
The absolute width and the width relative to the number of steps answer different questions. In the fair case the standard deviation grows from to , while shrinks from to . At , the standard deviation is , or times the fair width, and . Centering and dividing by each walk's own standard deviation gives, for ,
This rescaling equalizes the variances, not the entire probability distributions. The spacing between reachable endpoints is two, so its rescaled spacing is : approximately for the fair -step walk, for the fair -step walk, and for the biased -step walk.
The positions themselves are dependent. For , , where the second term is independent of . Their covariance is therefore
For example, in the fair case allows or , whereas allows or . Nevertheless the position process is a Markov chain: given its current position, the next fresh increment has no dependence on its past. Its transition probabilities are
These transition probabilities are the same at every time and every integer position: shifting both and by the same integer leaves unchanged. Thus the Markov property and independent increments coexist with dependent positions.
Sinc function Created 2026-10-06 Updated 2026-10-31
The unnormalized sinc function is , extended by value one at zero. The normalized sinc function is , with the same removable value. These arise, with convention-dependent scaling, as inverse Fourier transforms of frequency-interval indicator functions, so they describe ideal low-pass filters and the Shannon scaling function.
For any Lebesgue measurable set , the singular support of its indicator function, viewed as a regular distribution, is the intersection of the two essential closures in the displayed formula. Outside this intersection the indicator function is constant almost everywhere on a ball and hence represents a smooth function. At a point in the intersection, each sufficiently small ball has positive Lebesgue measure in both sets. Any continuous representative on that ball must take only the values zero and one everywhere: every other value would persist in a smaller ball and violate equality almost everywhere. By connectedness of the ball it would then be constant, a contradiction.
If is open, its essential closure is its relative closure. Its singular support can still be smaller than its topological boundary: represents the constant one and has empty singular support.
Target: Support and singular support rules for convolution. Parent: Convolution of distributions with a compactly supported factor. Intended file: fourier-analysis.bigb.
Spectrum of a bounded operator Created 2026-09-28 Updated 2026-10-14
Let be a Banach space over the complex numbers, and let be a bounded linear operator defined on all of . Its spectrum consists of those for which has no everywhere-defined bounded inverse. Its complement is the resolvent set of an operator . By the bounded inverse theorem, a bijective automatically has a bounded inverse. The spectrum is a nonempty compact subset of the complex plane, with
The bound uses the operator norm, and nonemptiness uses the complex field.[ref] For a real linear operator, complex spectral values are understood by extending it to a complex vector space; restricting to the real field can give an empty set.
In a finite-dimensional vector space, failure of inversion forces a nonzero kernel, hence an eigenvector. An infinite-dimensional vector space allows an injective shifted linear operator that cannot solve every equation . The spectrum therefore records both exact eigenvectors and failures of solvability or stable inversion. Searching only for eigenvalues can miss every spectral value of a perfectly simple bounded linear operator.
Consider the multiplication operator on the complex L2 space , with Lebesgue measure:
Its operator norm is one. The inequality gives the upper bound; unit vectors concentrated near approach it. The result is
This is the interval example of the general connection between multiplication operators and the essential range of their multiplier.[ref] Indeed, an eigenfunction would satisfy almost everywhere. It vanishes except possibly on the singleton , a null set; such a function is the zero vector in L2 space. Concentrating at one point cannot produce a nonzero L2 function.
For , the inverse is completely explicit:
The distance to a set is positive, so the inverse multiplier is bounded. Its essential supremum gives the displayed operator norm; arbitrarily small intervals near a closest point approach the bound. Our resolvent of an operator uses , the negative of this inverse, with the same operator norm. For , , and , the inverse norms are respectively , , and . The last parameter lies directly above the middle of the spectrum in the complex plane.
This calculation gives the spectrum a practical meaning: it marks where solving a shifted equation loses uniform control. At , the largest amplification of an input error is . Changing from to increases that factor from ten to one hundred. The equation remains uniquely solvable for each nonzero , but its sensitivity grows as the parameter approaches the spectrum.
Figure 1.
An interval without eigenvectors and a diagonal spectrum accumulating at zero
. Details.
To see directly why every belongs to the spectrum, choose and define a clipped interval and a normalized indicator function:
Its L2 norm is exactly one, including at both endpoints. On its support, , giving
Thus any choice produces approximate eigenvectors. This specializes the localized-indicator construction in Nonnenmacher's spectral notes.[ref] A hypothetical bounded inverse would imply , impossible for arbitrarily small .
For an interior point with , and the residual is exactly . At or , and the same residual formula holds, but the amplitude is rather than . At , taking gives amplitudes approximately and residuals . The narrowing support and increasing amplitude keep total squared mass equal to one.
For every , the continuous spectrum description is also concrete. Any L2 function can be approximated in L2 norm by its truncations to . Each truncation lies in the range of , since division there is bounded. The range is therefore dense. However, the constant function has no L2 function preimage: is not square-integrable, including at the endpoints.
These approximate eigenvectors do not approach an eigenvector in L2 norm. Any possible limit would have L2 norm one and satisfy by continuity, contradicting the empty point spectrum. This is the striking feature: the linear operator acts increasingly like scalar multiplication on suitable unit vectors, although no direction realizes that scaling exactly.
Figure 2.
Unit L2 vectors concentrate while their spectral residual tends to zero
. Details.
A complementary example is the diagonal operator on sequence space on complex l2 sequence space, with . The coordinate unit vectors satisfy , so
Zero is not an eigenvalue, since forces every coordinate to vanish. Nevertheless : these are approximate eigenvectors at zero. More concretely, belongs to l2 sequence space, but would require for all , which does not. Outside the displayed closed set, division by is uniformly bounded, proving that no further spectral values occur. Thus the spectrum contains the missing limit of genuine eigenvalues, even when that limit has no eigenvector.
The BV lattice inequality applied to two indicator functions gives the perimeter inequality. For smooth approximations, minima and maxima partition the two gradients; sequential lower semicontinuity passes the estimate to BV. It prevents a crossing of minimizers with strictly ordered set forcing.
Support function 2026-09-28
The support function of a nonempty set is . It is convex and positively homogeneous, and for a closed convex set its convex conjugate is the indicator function of .
Tail probability Created 2026-10-03 Updated 2026-10-14
For a real random variable , an upper-tail probability has the form and a lower-tail probability has the form . Each is the probability of an event lying beyond a chosen threshold in one direction. A tail probability need not be small: the threshold determines how much of the probability distribution it includes. A concentration inequality bounds such probabilities, often for deviations from an expected value.
Endpoint conventions matter. Write for the cumulative distribution function and . The complement rule of probability gives four distinct formulas:
The strict upper-tail convention is the survival function . Its value differs from the inclusive upper tail probability by exactly the probability mass at the threshold:
A singleton with positive probability mass is an atom of a measure. Thus excludes an atom of a measure at , whereas includes it. These endpoint identities follow directly from the cumulative distribution function properties in Kyle Siegrist, Distribution and Quantile Functions: endpoint probabilities and right tails.
As the threshold increases, both upper tail probabilities are nonincreasing functions. The strict survival function is a right-continuous function; the inclusive upper tail probability takes the upper endpoint value at a downward jump, equal to the left limit of the survival function. Both tend to zero as for a real random variable, but the speed of that decay differs across probability distributions. The cumulative distribution function properties and their proof from continuity of probability measures are given in MIT 6.436J, Lecture 4: random variables and cumulative distribution function properties.
For a fair six-sided die , the discrete uniform distribution assigns probability mass to each of . At threshold four,
Between four and five, both upper tail probabilities equal . At the largest possible outcome the distinction is especially visible: , but . The diagram shows exact probabilities for this mathematical model; its dots specify which endpoints belong to each step function.
Figure 1.
Exact fair-die probabilities: including or excluding a threshold changes the tail by one atom
. Details.
If a probability distribution has a probability density function , then every singleton has zero probability mass and
For an exponential distribution of rate two, for and zero otherwise, so for and for . Hence . This tail probability is an integral of the probability density function, not its height . A mixed probability distribution retains endpoint jumps even with a smooth component: give zero probability mass and choose this exponential distribution with probability . Then , , and for .
A two-sided tail probability can measure the absolute value of displacement from a specified center . For , the two extreme events are disjoint events, so
For strict displacement , replace the last expression by . The condition prevents overlap; at adding inclusive tails double-counts any probability mass at . For a uniform distribution on , take and : the two tail probabilities are each and their sum is . Equal tails follow from this symmetric probability distribution, not from the phrase two-sided alone; for a uniform distribution on with , the two tail probabilities are zero and .
The tail-sum formula for expectation turns a whole curve of tail probabilities into an expected value. For any nonnegative random variable , without assuming a probability density function or a finite expected value,
For a proof outline, write pointwise and exchange the expected value and Lebesgue integral using Tonelli theorem; is an indicator function. The inclusive version has the same Lebesgue integral: positive probability masses occur at only a countable set of thresholds, which has Lebesgue measure zero. For a nonnegative integer-valued random variable , the tail-sum formula instead gives . The integer hypothesis is essential for these sums. The integral identity, its indicator function proof, and the integer version appear in Kyle Siegrist, Additional Properties of Expected Value: integration and summation of right tails.
For the fair die, this tail-sum formula yields , equal to the direct weighted arithmetic mean . For the rate-two exponential distribution, the area under the survival function is , its expected value. The first panel below shades an integral of the probability density function for a single threshold; the second shades an integral of the survival function across all nonnegative thresholds. These are analytical illustrations, with the displayed curves truncated at three; their exact total areas use an infinite integration range.
Figure 2.
Exponential model: one tail probability is density area, while expectation is total survival area
. Details.
Nonnegativity is essential to interpreting the upper tail probability area as : for a general real random variable that area equals the expected value of its positive part. An integrable random variable satisfies , subtracting the expected value of its negative part; infinite terms cannot be canceled. Even when is finite almost surely, its expected value can be infinite. For the shape-one Pareto distribution on , on and for , so the area is . The finite versus infinite expected value distinction is illustrated in Kyle Siegrist, Definitions and Basic Properties: exponential and Pareto expected values.
Why are tail probabilities useful? They answer threshold questions directly, and a concentration inequality can bound them without knowing the full probability distribution. For nonnegative with finite expected value, Markov inequality gives for : a large threshold relative to the expected value forces rarity. The quantile function reverses the question by choosing a threshold for a prescribed cumulative level. If with , then ; an atom of a measure may prevent equality. For the die, , with strict upper tail probability zero and inclusive upper tail probability .
A tail probability describes rarity under a specified probability distribution; it is not automatically a conditional probability after extra information. For with ,
because the threshold events are nested. Thus the die has but . Conditioning changes the sample space and renormalizes its probability measure; the same extreme outcomes can become common in that restricted population.
Tail-sum formula Created 2026-09-24 Updated 2026-10-18
The tail-sum formula expresses an expected value as the area under a survival function. For every nonnegative random variable ,
This Lebesgue integral and the expected value may both be ; a probability density function is unnecessary. For a random variable taking values in the nonnegative integers, the corresponding sum is
The events and coincide because takes integer values. Thus the strict sum starts at zero, while the inclusive sum starts at one.[ref]
For an original example, let the probability mass function of be
Its expected value computed directly is . The strict tail probabilities at thresholds are : their sum is again . There is no probability mass at two, yet the event still has probability . The survival function has heights on the successive intervals ; each interval has length one, so its integral is the same sum.
Figure 1.
The same expected value from probability masses and survival columns
. The exact constructed probability mass function assigns to . The contribution appears in one survival column, while the contribution appears in three. Filled endpoints give the strict survival function at its jumps; open endpoints show the preceding height. The shaded area is . Details.
The indexing matters numerically. Starting the inclusive sum at zero adds , giving for this example. Starting the strict sum at one omits , giving . For a general nonnegative random variable, replacing with inside the integral is harmless: the difference is , nonzero at only a countable set of thresholds. For each positive integer , at most thresholds can have probability mass at least ; their countable union contains all thresholds with positive probability mass and has Lebesgue measure zero. This reasoning concerns an integral, not equality of the two survival function conventions at every point.
For a continuous original example, take the uniform distribution on the interval . Its survival function is for and zero for . The area is a triangle of base four and height one:
Directly integrating against the probability density function gives the same expected value, . The integral of the probability density function alone is one; it is the survival function whose area is the expected value.
Figure 2.
A uniform density has total probability one and survival area two
. Exact curves for the uniform distribution on . The probability density function has integral one, while the survival function has integral two. Splitting the survival area at gives before the cap and beyond it, the expected values of and the positive part , respectively. Details.
The proof counts layers of each outcome. For a realized value , the indicator function equals one over an interval of length , so
Tonelli theorem permits the interchange because the indicator function is nonnegative; no finite expected value is assumed. Similarly, an outcome contributes one indicator random variable for each of the events that occur:
Again Tonelli theorem applies to the nonnegative sum, or equivalently the monotone convergence theorem applies to its partial sums. This exchanges counting layers within each outcome with averaging across outcomes. The existing integer-valued hypothesis in the tail-sum formula explains what changes when the values are not integers; the tail integral formula for moments weights the layers to obtain higher moments.
For an integrable random variable that can have either sign, apply the nonnegative formula separately to its positive part and negative part :
Integrability makes both integrals finite. More generally the difference defines an extended expected value when at least one is finite; if both are infinite, subtraction does not define an expected value.[ref]
Tail probabilities are often easier to measure or bound than a whole probability density function. For a device's survival time, the survival function records the probability of still operating at each threshold; its integral gives the mean operating time. A finite observation window naturally gives the expected value of a capped nonnegative random variable. For a mathematical bound, for all implies . The tail-sum formula turns control of a whole family of events into control of an average.
Translation continuity in Lp Created 2026-10-06 Updated 2026-10-14
For and , translations converge to in the Lp space norm. First prove this for continuous compactly supported functions, using uniform continuity and a common bounded support. Their density in Lp space, together with the norm-preserving translation map and the triangle inequality, proves the assertion for arbitrary . It implies convergence of averages over shrinking intervals, a basic approximate identity argument. The corresponding assertion fails for general functions, such as an indicator function with a jump.
Translating a Lebesgue measurable set by a real number preserves measurability and its Lebesgue measure. Translation invariance of Lebesgue outer measure and Carathéodory's criterion give the measurability assertion and equality. Applying the result to indicator functions, then simple functions, and finally increasing simple approximations gives for every nonnegative Lebesgue measurable function. For a Lebesgue integrable function, apply the identity to its positive part and negative part.