Rayleigh radial thresholds and quantiles 2026-10-18
For , integration gives the survival function and cumulative distribution functionSolving gives the quantile function[ref]
The Rayleigh Distribution. Random: Probability, Mathematical Statistics, Stochastic Processes by Kyle Siegrist; The General Rayleigh Distribution, Distribution Functions: CDF, quantile and survival functions
For the chosen positioning model ,The disk of radius one component standard deviation therefore contains about 39.35% of outcomes; the familiar one-dimensional normal interval percentage does not apply to a two-dimensional disk. The 95% and 99% radial thresholds areA circle defined by itself still has probability zero; its enclosed disk carries the stated probability.
The closed-form quantile function also gives inverse transform sampling: if has uniform distribution on , then has Rayleigh distribution. Using instead gives the same law. Endpoints are excluded so that the logarithm stays finite.
Return level Created 2026-10-06 Updated 2026-10-14
A return level answers the inverse question to a return period: which threshold has the specified rarity? Let be the common cumulative distribution function of annual sample maxima in a model with stationarity. For a continuous, strictly increasing and , the -year return level isIt has the same units as , whereas is a count of annual blocks. Independence between years is unnecessary for this one-year quantile definition; it is needed for the geometric waiting and multi-year formulas under return period. For a discrete probability distribution, use the generalized quantile function . Then , with equality not guaranteed at jumps; an exact requested exceedance probability may be unattainable.
For a concrete standard model, choose the maxima convention of the Gumbel distribution, with location and scale :The second formula follows by taking logarithms twice and solving . The maxima cumulative distribution function and its inverse are given in NIST: extreme value type I distribution, maximum case. With the deliberately chosen toy values and in arbitrary units, , , and , rounded to three decimals. In particular, is approximately the annual quantile at cumulative probability ; it is not a prediction of the largest observation in the next 100 years. Under independence, the probability that all those annual sample maxima stay below the exact is .
The time block matters. If a toy year contains independent daily blocks, each with exceedance probability at one fixed threshold, its annual exceedance probability is , giving annual return period . The reciprocal counts daily blocks. Dependence among daily exceedances requires their joint law instead; a threshold crossed on several successive days still produces only one exceedance indicator for that year's sample maximum. The peaks-over-threshold method and declustering of extremes address a different choice of extreme-event sampling.
Sampling a discrete uniform distribution 2026-10-14
Let the numerical support of a probability distribution be . Its cumulative distribution function counts how many values have been passed:It is zero below , equals on for , and is one at and above . Every jump is , even when the horizontal gaps differ.
For inverse transform sampling, take an ideal continuous uniform distribution for on . Partition that interval into intervals of width and outputEach interval has probability , proving the desired discrete uniform distribution. Using the floor function, the index is ; for consecutive integer values the output is . With the usual quantile function convention , one instead writes for , using the ceiling function. The endpoint conventions differ only at a finite set of points with probability zero under the ideal continuous uniform distribution.
For , the four intervals , , , and select , respectively. Thus selects , while selects . The upper half of the interval selects values at least four, recovering probability . Equal widths refer to the sampling probability coordinate, not to distances between output values. This is an exact mathematical construction assuming an ideal continuous uniform distribution; a finite computer random-number source needs its own justification of equal output chances.
Semi-log plot 2026-10-18
A semi-log plot uses a logarithmic scale on one axis and a linear scale on the other. Which axis is logarithmic matters. Plotting against makes positive exponential functions appear as straight lines; plotting against instead makes an affine function of a logarithm appear straight. The plotting operations change positions while retaining the original tick values.[ref]
Log scale. Matplotlib 3.10.7 documentation; Matplotlib 3.10.7, Log scale: Convenience functions semilogx, semilogy, and loglog; distinction between horizontal and vertical logarithmic axes
Take the original dimensionless mathematical model for . It has exponential growth, with , , and . Taking a base-ten logarithm givesThe slope in these transformed positions is , although the original relative growth rate is . Equal steps of two in multiply by . The corresponding ordinary gains increase, so the left plot bends while the right plot is straight.
The same exponential growth model bends on a linear scale and is straight on a semi-log plot with a logarithmic vertical axis
. Original exact mathematical model , not measurements. Both panels show identical values at the same . Right-hand tick labels retain the original values, with equal gaps for each doubling. The stated slope is for , not the original derivative . Details.One practical use is checking a proposed exponential distribution for failure times. For rate and , its cumulative distribution function is , so the reciprocal survival function satisfies . Estimated probabilities can therefore be placed on a logarithmic vertical axis and compared with a straight line. Agreement supports compatibility with the chosen statistical model; a roughly straight finite sample does not establish a unique physical mechanism.[ref]
8.2.2.1. Probability plotting. NIST and SEMATECH e-Handbook of Statistical Methods, §8.2.2.1 Probability plotting: Exponential Model, logarithmic vertical-axis transformation and interpretation of approximate straightness
Sequential private-value all-pay contest 2026-10-06
Two players pay their invested efforts regardless of outcome. A leader invests first, and a follower observes that effort before deciding. With ties favoring the follower and unit costs, a follower of value matches leader effort when , and otherwise declines. For a continuous follower cumulative distribution function , the leader wins with probability and has payoff .
Fix a failure probability and assume an independent and identically distributed statistical sample. A finite-sample confidence band for its population cumulative distribution function isHere is the natural logarithm. The DKW inequality impliesThis is simultaneous coverage over the whole real line, valid at each fixed sample size.[ref]
To obtain the band, solve for the positive . Outside a failure event of probability at most , for every . Since a cumulative distribution function already lies in , clipping the endpoints to this interval preserves the coverage event. The guarantee is at least , and need not equal it.
Choose , giving at least simultaneous coverage under the stated model. For , respectively, the half-widths before clipping areFor the chosen five observations, the band at is , while at it is approximately . At the unclipped band would be , so clipping gives . The broad uncertainty is informative: five observations give a precise description of themselves, but a coarse bound for an unknown population cumulative distribution function.
Finite-sample simultaneous uncertainty around an empirical distribution function
. Left: the chosen five observations give and its band clipped to , using . Right: theoretical half-widths for , with no additional samples constructed. The confidence band has coverage at least under independent and identically distributed sampling; the drawing illustrates the procedure and does not establish its coverage. Details.A collection of pointwise confidence intervals only promises coverage separately at each preselected threshold; it does not promise coverage of an entire cumulative distribution function. Here the one simultaneous event permits inspecting any threshold after seeing the data. The probability refers to repeated sampling of the entire statistical sample, with fixed. It does not assign probability to a fixed after observing this particular band, and it is not a prediction interval for a future observation. The displayed comparison gives a guarantee for each fixed separately, not simultaneous validity over all sample sizes or an optional stopping rule. The chosen observations are an illustration; the coverage claim follows from the DKW inequality, not from their appearance or a simulation. Dependence or observations with different sampling laws require another argument.
At fixed , multiplying by divides the half-width by . Conversely, a desired half-width is ensured by , rounded up to an integer. For and , this sufficient sample size is . This makes the confidence band useful for planning how many observations are needed before estimating threshold probabilities to a chosen simultaneous accuracy.
Singular continuous distribution 2026-10-31
A probability distribution is singular continuous if it has no point masses and assigns probability one to a set of zero Lebesgue measure. Its cumulative distribution function is continuous, but the distribution has no probability density function with respect to Lebesgue measure. This distinguishes continuity of the cumulative distribution function from an absolutely continuous probability distribution, whose probabilities are integrals of a probability density function.
Small normal sample mean confidence interval 2026-10-18
Under the studentized normal sample mean assumptions, let denote the quantile at cumulative probability of the Student's t-distribution. For , rearranging the event gives a Student t confidence interval for the unknown mean with exact coverage probability . [ref]
Choose the list as an original arithmetic example, not as reported measurements or a claim that these five numbers establish a normal distribution. If such values were obtained under the assumed independent and identically distributed normal distribution model with unknown , thenThere are four statistical degrees of freedom. For a 95% confidence interval, , soUsing the standard normal quantile with the same estimated standard error would give only . That underestimates the correct margin by about 29.4%. Indeed its actual coverage probability under this normal distribution model is , rather than 0.95.
The observations, the sample mean and the confidence interval all have different meanings. The bar estimates the population mean; it is not an interval intended to contain 95% of individual observations. In repeated independent samples of size five from the assumed normal distribution, 95% of intervals constructed using the exact quantile cover the same fixed . This is not a 95% posterior probability that the fixed statistical parameter lies in this particular realized interval. Such a probability requires a separate Bayesian inference model.
For this four-degree case, the cumulative distribution function has an especially simple form:One can check the formula by differentiation: , with limits zero and one at the two ends of the real line. Solving the increasing equation by the bisection method gives the quantile used above.
Squared uniform distribution Created 2026-10-06 Updated 2026-10-14
The square of a uniform distribution variable on has cumulative distribution function and an integrable inverse-square-root probability density function. Reflection replaces by in that density.
Square of a standard Laplace variable 2026-10-25
For a random variable with probability density function , the event is for . Integrating the symmetric density gives the displayed cumulative distribution function; it is zero for negative . The density on is . Its integrable singularity at zero does not create an atom, because the cumulative distribution function is continuous there.
Standard normal distribution function Created 2026-09-24 Updated 2026-10-14
The standard normal distribution function is the cumulative distribution function of a standard normal random variable :Here is the standard normal density and is the error function. The symmetric probability distribution gives and , while differentiation gives . For with , standardization of a normal random variable gives ; subtracting two values calculates an interval probability.
Survival function Created 2026-09-24 Updated 2026-10-14
For a nonnegative survival time , the survival function iswhere is the cumulative distribution function. Thus is the probability that the chosen occurrence is still in the future at time . We consistently use the strict inequality : a probability mass at has already left the survival function at itself. With this convention is a right-continuous function and a nonincreasing function taking values in . If , then ; if is finite with probability one, then as .
For and , conditional probability givesFor example, and mean that of those still event-free at year two remain event-free through year five. Their intervening event probability is , whereas the original population's probability of an occurrence in is . Conditioning changes the denominator.
The area under the survival function up to a horizon gives the restricted mean survival time. A positive terminal plateau in a plotted Kaplan–Meier estimator does not establish that the occurrence will never happen: terminal censoring and survival-mean identifiability explains why the unobserved tail remains undetermined.
Symmetric rational mixture sampler 2026-10-14
The displayed mixture distribution combines a Standard Cauchy distribution and a symmetric law whose magnitude has cumulative distribution function for . Use independent uniforms : if , return ; otherwise return a fair independent sign times . The magnitude density is and splitting its mass equally between signs gives . An alternative rejection sampling proposal is standard Cauchy, with envelope constant , because .
Tail probability Created 2026-10-03 Updated 2026-10-14
For a real random variable , an upper-tail probability has the form and a lower-tail probability has the form . Each is the probability of an event lying beyond a chosen threshold in one direction. A tail probability need not be small: the threshold determines how much of the probability distribution it includes. A concentration inequality bounds such probabilities, often for deviations from an expected value.
Endpoint conventions matter. Write for the cumulative distribution function and . The complement rule of probability gives four distinct formulas:The strict upper-tail convention is the survival function . Its value differs from the inclusive upper tail probability by exactly the probability mass at the threshold:A singleton with positive probability mass is an atom of a measure. Thus excludes an atom of a measure at , whereas includes it. These endpoint identities follow directly from the cumulative distribution function properties in Kyle Siegrist, Distribution and Quantile Functions: endpoint probabilities and right tails.
As the threshold increases, both upper tail probabilities are nonincreasing functions. The strict survival function is a right-continuous function; the inclusive upper tail probability takes the upper endpoint value at a downward jump, equal to the left limit of the survival function. Both tend to zero as for a real random variable, but the speed of that decay differs across probability distributions. The cumulative distribution function properties and their proof from continuity of probability measures are given in MIT 6.436J, Lecture 4: random variables and cumulative distribution function properties.
For a fair six-sided die , the discrete uniform distribution assigns probability mass to each of . At threshold four,Between four and five, both upper tail probabilities equal . At the largest possible outcome the distinction is especially visible: , but . The diagram shows exact probabilities for this mathematical model; its dots specify which endpoints belong to each step function.
If a probability distribution has a probability density function , then every singleton has zero probability mass andFor an exponential distribution of rate two, for and zero otherwise, so for and for . Hence . This tail probability is an integral of the probability density function, not its height . A mixed probability distribution retains endpoint jumps even with a smooth component: give zero probability mass and choose this exponential distribution with probability . Then , , and for .
A two-sided tail probability can measure the absolute value of displacement from a specified center . For , the two extreme events are disjoint events, soFor strict displacement , replace the last expression by . The condition prevents overlap; at adding inclusive tails double-counts any probability mass at . For a uniform distribution on , take and : the two tail probabilities are each and their sum is . Equal tails follow from this symmetric probability distribution, not from the phrase two-sided alone; for a uniform distribution on with , the two tail probabilities are zero and .
The tail-sum formula for expectation turns a whole curve of tail probabilities into an expected value. For any nonnegative random variable , without assuming a probability density function or a finite expected value,For a proof outline, write pointwise and exchange the expected value and Lebesgue integral using Tonelli theorem; is an indicator function. The inclusive version has the same Lebesgue integral: positive probability masses occur at only a countable set of thresholds, which has Lebesgue measure zero. For a nonnegative integer-valued random variable , the tail-sum formula instead gives . The integer hypothesis is essential for these sums. The integral identity, its indicator function proof, and the integer version appear in Kyle Siegrist, Additional Properties of Expected Value: integration and summation of right tails.
For the fair die, this tail-sum formula yields , equal to the direct weighted arithmetic mean . For the rate-two exponential distribution, the area under the survival function is , its expected value. The first panel below shades an integral of the probability density function for a single threshold; the second shades an integral of the survival function across all nonnegative thresholds. These are analytical illustrations, with the displayed curves truncated at three; their exact total areas use an infinite integration range.
Nonnegativity is essential to interpreting the upper tail probability area as : for a general real random variable that area equals the expected value of its positive part. An integrable random variable satisfies , subtracting the expected value of its negative part; infinite terms cannot be canceled. Even when is finite almost surely, its expected value can be infinite. For the shape-one Pareto distribution on , on and for , so the area is . The finite versus infinite expected value distinction is illustrated in Kyle Siegrist, Definitions and Basic Properties: exponential and Pareto expected values.
Why are tail probabilities useful? They answer threshold questions directly, and a concentration inequality can bound them without knowing the full probability distribution. For nonnegative with finite expected value, Markov inequality gives for : a large threshold relative to the expected value forces rarity. The quantile function reverses the question by choosing a threshold for a prescribed cumulative level. If with , then ; an atom of a measure may prevent equality. For the die, , with strict upper tail probability zero and inclusive upper tail probability .
A tail probability describes rarity under a specified probability distribution; it is not automatically a conditional probability after extra information. For with ,because the threshold events are nested. Thus the die has but . Conditioning changes the sample space and renormalizes its probability measure; the same extreme outcomes can become common in that restricted population.
Tangent of a uniform angle has a Cauchy distribution Created 2026-10-18 Updated 2026-10-20
If and has the continuous uniform distribution on , then has the Cauchy distribution with location zero and scale . The tangent function is strictly increasing on this interval, so its cumulative distribution function isDifferentiating gives the probability density function . The probability of either endpoint is zero, so including endpoints in the uniform interval does not alter this probability distribution. The slow quadratic decay makes the expected value undefined: its positive and negative parts both have infinite integrals. Its second moment is also infinite, so it has no finite standard deviation.
Uniform distribution with an atom at zero Created 2026-10-18 Updated 2026-10-20
For and , this mixed probability distribution has probability mass at zero and ordinary probability density function on . That ordinary density integrates to , not to one; conditioned on , the law is the uniform distribution on . Its cumulative distribution function is zero for , for , and one for .
For each positive integer , integration gives . Thus the expected value is and the variance is . The nonzero atom contributes to normalization even though it contributes zero to positive moments. At , conditioning on positive delay is undefined because the conditioning event has probability zero.
Uniformized sample range Created 2026-10-14 Updated 2026-10-18
For an iid sample of size from a continuous cumulative distribution function, the probability integral transform makes the transformed sample uniform. Integrating the joint density of its minimum and maximum gives range density on . Its distribution function is . The result describes population content between the extreme order statistics, independently of the underlying continuous distribution.
Uniformly most powerful test for a gamma rate Created 2026-10-25 Updated 2026-10-31
For an independent statistical sample from a gamma distribution with known shape and unknown rate , test against . The alternative-to-null likelihood ratio for any larger rate is , where . This decreases in , so the Neyman-Pearson lemma gives one common lower-tail ordering for all alternatives.
Let be the unit-rate gamma distribution cumulative distribution function with shape . The uniformly most powerful test of exact test size rejects when , where . Its power function is displayed above. If , the sum has an exponential distribution, so and . Monotonicity of also makes this test valid and uniformly most powerful for the larger null hypothesis .
Uniform order statistic Created 2026-09-28 Updated 2026-10-14
For independent and identically distributed random variables with the continuous uniform distribution on , the th order statistic has Beta distributionIts probability density function, mean, and variance areThe probability density function is zero outside ; values assigned to its endpoints do not change any probability. Peter Kempthorne's MIT lecture notes derive the uniform order statistic law and these moments. [ref]
https://ocw.mit.edu/courses/18-443-statistics-for-applications-spring-2015/06daf6d78e7eb0465d6bb53e8f96b2ff_MIT18_443S15_LEC11.pdf. Peter Kempthorne, MIT 18.443, Lecture 11, slides 12–14
.For , the minimum, sample median, and sample maximum correspond to . Their probability density functions are , , and , respectively. The sample median therefore has Beta distribution , mean , and variance . Its cumulative distribution function isFor instance, . The mean of the minimum is , and the mean of the sample maximum is . The fixed observed sample median in the order statistic example is one possible outcome; is the average over repeated statistical samples from this uniform distribution.
Each curve has area one. The extreme order statistics favor the ends, while the sample median favors the center. The endpoint density height is legitimate: the probability density function gives area per unit length, rather than point probability. In particular, a continuous uniform distribution has zero probability of producing an endpoint.
For a short proof, the binomial distribution counting identity under order statistic gives . Taking its derivative cancels consecutive terms, leaving the displayed probability density function. Recognize its normalizing factorial coefficient as that of the Beta distribution, then substitute , into the Beta distribution mean and variance formulas. Although the original observations are independent, their order statistics generally are dependent; see the positive covariance of two uniform order statistics.
For a positive continuous density with strictly increasing cumulative distribution function , observations from its upper-truncated law have likelihood on . Holding fixed, decreasing toward increases the likelihood; taking a supremum over preserves nonincreasing dependence on . Provided the nuisance fit is finite, the usual closed-support endpoint estimate is . With the literal open support , only a limiting supremum need exist. A sample maximum is not a validated bound for future observations, and support depending on a parameter prevents automatic application of Wilks theorem.






