Apollonius's theorem Created 2026-10-20 Updated 2026-11-05
For a triangle with vertices and midpoint of , Apollonius's theorem states
Thus the length of a median of a triangle is determined by the three side lengths. Put the origin at , so , , . Expanding the dot products in cancels the cross terms, giving . Since , this proves the formula and relates it to the parallelogram law. For sides , , the median has length four.
Arithmetic mean Created 2026-09-24 Updated 2026-10-14
For a nonempty finite list of real numbers , the arithmetic mean is
It is the weighted mean with equal weights, giving each observation equal influence. For , the sum is and the arithmetic mean is . Replacing every value by retains the same total. The residuals sum to zero, so the mean is also the balancing point of these equally weighted observations.
The arithmetic mean minimizes the sum of squared deviations by the weighted mean minimizes squared deviations identity with all weights one. A large input can consequently have a substantial effect: replacing by changes the mean to , while the median remains . The choice of summary depends on what aspect of the data matters.
Asymptotic distribution of a sample median Created 2026-09-24 Updated 2026-11-05
Let be independent and identically distributed random variables with unique median , and let their probability distribution have continuous probability density function with . For odd , the sample median satisfies
The influence function of the sample median has mean zero and variance : each of its two nonzero values occurs with probability . Its asymptotic linear representation, followed by the central limit theorem, gives the displayed limit.
For a standard normal distribution, , so the asymptotic variance of the unscaled sample median is . The sample mean instead has variance in that model. This quantifies an efficiency cost at the reference model without contradicting the sample median's bounded response to an outlier.
Bayes estimator under weighted absolute loss Created 2026-10-14 Updated 2026-11-05
For loss , assume , and . The posterior expected loss is a positive constant times absolute-error loss under the posterior distribution reweighted by . Thus its minimizers are the medians of that weighted posterior distribution. More precisely, the weighted cumulative distribution function satisfies ; the one-sided slopes of the convex loss give this condition.
For relative absolute loss on positive parameters, . With a gamma distribution posterior of shape two and rate , reweighting produces an exponential distribution of rate , so the estimate is . The weighted first-moment condition ensures finite loss; without it every finite action can have infinite loss, making a median characterization uninformative.
Box plot 2026-10-14
A box plot compresses a statistical sample into a box spanning its lower and upper quartiles , a line at its median , and two whiskers. It makes location and central spread easy to compare across groups on a common value axis. The box represents the central half in terms of quantile levels; with ties or interpolated quartiles, it need not contain exactly half the observations. Whisker endpoints require a stated convention: they can be the observed extremes, or they can stop short of separately marked observations. [ref]
Here is one explicitly toy dataset, reused under histogram: twelve invented, unitless values, with repeated values counted separately, already arranged as order statistics:
For this box plot we choose the interpolated quartiles defined under quartile, using R's type-7 rule. This gives
The interquartile range is . Our whisker convention uses the fences
The whiskers end at the smallest and largest observations in the closed interval : here and . Values strictly outside the fences receive separate outlier markers: here only . An observation exactly on a fence is retained within the whisker under this convention. The fences are thresholds, not observed whisker endpoints; the upper whisker is at , not . R's documented whisker rule likewise includes observations no more than box lengths away, although its box uses hinges, which can differ from our type-7 quartiles. [ref]
Figure 1.
Toy box plot: quartiles define the box, observations define the whiskers
. The twelve invented values are shown individually below the box plot, with repeated values stacked. Type-7 quartiles are ; the interquartile range is . Dashed fences at and determine whiskers at and and a separate marker at . The fence lines and raw-value strip are explanatory additions, not required parts of every box plot. Details.
A separate outlier marker is a prompt to investigate, not a finding that the value is bad data and not an instruction to delete it. A distant observation can be a recording error, a legitimate unusual outcome, or evidence that the assumed statistical model misses some behavior. Check its provenance and context before deciding how to analyze it. No measurement-error claim is possible for our invented : we deliberately put it there to demonstrate the rule. [ref]
The beauty of a box plot is its compact comparison of ordered positions rather than every observation. That compression also loses information: many different statistical samples have the same quartiles and whiskers, so the box alone cannot reveal every cluster or gap that a histogram might show. For example, replacing the two invented values by and leaves the type-7 quartiles, whiskers and separate marker unchanged. Displaying the individual values alongside the box plot is especially helpful for such a small statistical sample. Always state both the quartile rule and the whisker rule; changing either can change which values are marked.
Bradley Efron Created 2026-10-18 Updated 2026-11-05
Bradley Efron's work connects statistical theory, computation and applications. His bootstrap estimates a statistic's sampling uncertainty by repeatedly sampling from the empirical distribution and recalculating that statistic. For example, resampling the observed data and recomputing a median produces a simulated sampling distribution without requiring a normal population model. Validity still depends on the statistic and sampling setting; the method is not automatically correct for every extreme-value or dependent-data problem.
His bootstrap work has distinct records as a July 1977 Stanford technical report and a January 1979 journal article.[ref][ref] His Stanford profile describes research spanning theoretical statistics, biostatistics and astrophysical applications.[ref]
Figure 1.
Portrait of Bradley Efron at the 2007 National Medal of Science ceremony
. Ryan K. Morris, National Science and Technology Medals Foundation; cropped by Wikimedia user Dudek1337. Public domain, as recorded on Wikimedia Commons. Source usage terms. Source.
Concentration inequality Created 2026-09-24 Updated 2026-11-05
A concentration inequality bounds the probability that a random variable differs substantially from a typical value such as its expected value or median.
Let be an integer median for the longest convex chain length of independent uniform points in a triangle. If , fix a certificate of coordinates. Every configuration with must disagree with at least of those coordinates; equal weights prove Talagrand convex distance separation at least . Talagrand's convex distance inequality then gives . Set , then , in the two respective applications to obtain the displayed tails for positive integer . The exact chain-counting bound gives . Hence any interval centred at with length , where , contains with high probability. No upper restriction on the growth of is required.
Coordinatewise median Created 2026-09-28 Updated 2026-11-05
The coordinatewise median of vectors applies the univariate sample median separately to each coordinate. It is easy to compute but depends on the chosen coordinate axes.
At a smooth point with nonzero gradient, rotate coordinates so . Write . A candidate median has level boundary in the disk. The area imbalance is ; equal half-areas force . Here is the tangential second derivative, giving the formula. The disk uses uniform area measure, not its boundary measure.
Extreme value theory Created 2026-10-05 Updated 2026-10-14
Extreme value theory studies limiting probability distributions of normalized sample maxima and related extremes. The standard limits for maxima include the Fréchet distribution, negative Weibull distribution, and Gumbel distribution.
The question is often practical: if a batch finishes only when its slowest task finishes, its completion time is a sample maximum. A typical individual delay or a sample mean does not answer that question. The central limit theorem describes suitably normalized sums and sample means under its assumptions; it does not give a limit law for sample maxima. Extreme value theory instead describes how the largest observation changes as the number of opportunities for a large observation grows.
For independent and identically distributed random variables with distribution function , define the sample maximum
The event means that every observation is at most , so independence gives
Extreme value theory asks whether there are constants and for which has convergence in distribution to a non-degenerate probability distribution. Equivalently, must tend to a limiting distribution function at its continuity points. The extremal types theorem says that any such limit belongs, up to a change of location and positive scale, to the Gumbel distribution, Fréchet distribution, or negative Weibull distribution. It does not guarantee that a limit exists for every . [ref].
The maximum of independent exponential random variables gives a particularly transparent worked example: its center grows as , and its fluctuations have a Gumbel distribution limit on the scale . Here and below denotes the natural logarithm. This normalization depends on the exponential distribution. Other survival functions can lead to the Fréchet distribution or negative Weibull distribution, with different constants ; the Gumbel distribution and the exponential example's normalization are not universal.
Independence is essential to the product calculation. If instead for one rate- exponential random variable, then for every . Its distribution function stays for and zero below zero, and its median stays . Perfect dependence creates no logarithmic growth: repeating the same random variable supplies no new chance of a larger value.
A historical starting point is R. A. Fisher and L. H. C. Tippett's 1928 paper on limiting laws of the largest or smallest sample member, published in volume 24, issue 2, pages 180–190 of the Proceedings of the Cambridge Philosophical Society. Its abstract studies the possible limiting forms and emphasizes that approach to a limit can be slow. [ref].
Consider the population statistical model . The following are deterministic statistical functional calculations, not observed contamination experiments. Compare the actual location bias with the linear approximation . The mean bias is exactly . For positive exceeding the shifted median and , the generalized-inverse median bias is exactly
This formula applies to both and throughout the plotted interval . If the contaminating atom lies inside the quantile jump containing probability , the generalized-inverse median instead equals that atom.
For the Huber location estimator with and , solve its actual population equation, rather than substituting the influence function:
Writing and , integration of the normal distribution gives
where is the probability density function of . Its derivative is , so the mixture score is strictly decreasing for . For , its limits at negative and positive infinity have opposite signs even with arbitrary distant point contamination. The displayed examples use the unique root, evaluated by the bisection method to numerical precision.
Figure 1.
Exact population contamination biases and first-order influence predictions for normal location at contaminating points 1 and 8
. Details.
At and , the exact mean, median, and Huber location estimator biases are , , and ; the influence function predictions are , , and . At , they become , , and , versus predictions , , and . The bounded alternatives control the effect of the distant atom, but their actual response curves bend away from the tangent.
The nearby atom gives a useful comparison: at , the Huber location estimator bias is , slightly below its linear approximation , whereas the median bias is still . The direction and size of approximation error depend on the contaminating location. Even accurate local influence calculations must specify , the scale, the cutoff, and the actual contamination fraction.
Take independently decaying atomic nuclei, each with lifetime drawn from an exponential distribution of rate . With no replenishment, the survivor count is
Each indicator variable has success probability , so the binomial distribution gives
The smooth population law is the expected value , satisfying . One realization instead loses whole atomic nuclei at discrete times. An observed count above the smooth curve need not contradict the mathematical model.
For an original chosen example, let and half-life . Then . After , the survival probability is , giving
The standard deviation describes variation between repeated populations governed by these assumptions. It is not an uncertainty interval for a noiseless deterministic curve.
Figure 1.
Random survivor counts and the smooth radioactive-decay law
. Original constant-rate model with independent parent atomic nuclei and a half-life. Simulated histories are compared with their exact expected value and a one-standard deviation band. The second panel shows the exact binomial distribution after three half-lives. These are model calculations, not measurements from a historical sample. Details.
The half-life and the mean lifetime answer different questions:
The first is the median of one lifetime, or the time when half the population survives on average. The second is the lifetime's expected value. In this example they are and approximately .
Here is an original reproducible finite set with 40 points and 512 coordinates. Let be the first four vectors of the standard basis of . With point indices , generate
The four groups have different centers, and the standard normal random variables perturb all 512 coordinates. Generate the coordinates in row order using NumPy's PCG64 pseudorandom number generator with seed 20261013. Then keep this finite set fixed. A second PCG64 stream with seed 424242 generates a matrix of independent random variables with the standard normal distribution; divide it by to obtain the Gaussian Johnson–Lindenstrauss transform.
For all 780 unordered pairs, compute the distance ratio . In this draw, its minimum is approximately and its maximum , giving a maximum relative error in Euclidean distance of about . The squared-distance ratios instead range from approximately to : their maximum relative error is about . Thus this particular draw fails a 20% distance tolerance. The Johnson–Lindenstrauss lemma does not assert that every draw into 32 dimensions must succeed.
Figure 1.
All 780 pairwise Euclidean distances for one Gaussian map from 512 to 32 dimensions
. Details.
The two bands of original Euclidean distances distinguish pairs within a group from pairs between groups. Their spread after the linear map shows why checking an average distance is insufficient: the Johnson–Lindenstrauss lemma controls every pair. The dashed 20% distance band is an illustrative tolerance, not a confidence interval or a squared-distance band. The affine hull of 40 points has dimension at most 39; 512 is the ambient coordinate count, and no full-dimensionality assumption is required. For this draw the bi-Lipschitz distortion is approximately .
Now keep the same points and draw 48 fresh Gaussian Johnson–Lindenstrauss transforms for each target dimension . NumPy's SeedSequence(314159).spawn(240) supplies distinct PCG64 streams, ordered first by target dimension, then by draw. Each stream generates a new random matrix, normalized by ; no map is a row prefix of another map. Each plotted value is
Figure 2.
Maximum relative distance error over independently drawn Gaussian maps at five target dimensions
. Details.
The observed median maximum relative errors in Euclidean distance are approximately , , , , and , respectively. All pairs fall inside the 20% distance tolerance in , , , , and of the 48 draws, respectively. These are computations on one synthetic finite set, rather than optimal dimension bounds or measured physical data. The displayed quantiles describe the sampled maps; they do not certify a success probability for other sets. Even at 128 dimensions, 13 of the sampled maps fail this tolerance.
The practical benefit is that each point acquires fewer coordinates while its pairwise Euclidean distances can remain useful. The choice of target dimension balances compression, accuracy, and failure probability. For example, a conservative sufficient squared-distance tolerance with and gives by the explicit bound above. Here that exceeds the ambient dimension, so the identity map is better for a certified guarantee. The much smaller dimensions in the plots illustrate observed behavior without claiming that this sufficient bound is sharp.
Francis Galton's paper Regression towards mediocrity in hereditary stature by Francis Galton analyzes adult offspring heights against the average of their parents' adjusted heights. He multiplied female heights by before making that parental average. Table I contains 928 adult offspring from 205 parental pairs; the opening prose instead states 930. Its grouped readout is a median, and the explanation of Plate IX describes a smoothed offspring deviation about two-thirds of the parental deviation.[ref]
These were parent-offspring records, not repeat readings of an unchanged signal. The paper's group tendency does not say that every child must be closer to the population mean. Galton also reports uncertainty over whether some recorded heights included shoes, a concrete measurement error limitation.[ref] The Pearson correlation coefficient and all generated values above are our chosen model, not a reconstruction of his data.
For a positive response, the model with gives conditional median and conditional mean . The latter follows from the moment-generating function of a normal distribution. Additive factor effects in become multiplicative effects on these response summaries. Its constant log-scale variance corresponds to original-scale variance proportional to the square of the mean; direct exponentiation of fitted log means incurs retransformation bias.
Gumbel distribution Created 2026-10-05 Updated 2026-10-14
The standard Gumbel distribution for maxima has distribution function for every real . Its probability density function is the derivative of its distribution function:
This article uses the maxima convention throughout. Reflecting a standard Gumbel distribution random variable to gives the minima convention, with distribution function . The two conventions have opposite directions of asymmetry, so their formulas must not be interchanged. [ref].
For a location and positive scale , let . This location-scale family has cumulative distribution function and probability density function
Solving gives the standard quantile function , , and hence the standard median
The median of is therefore . Location is not the median: at the cumulative distribution function is .
To derive the Gumbel distribution as an extreme-value limit, take the maximum of independent exponential random variables with rate and set
The exact distribution function is
The finite- lower boundary is required because . For each fixed real , eventually , and the natural logarithm of the first branch satisfies
Exponentiating proves convergence in distribution to the standard Gumbel distribution. It is the familiar limit with : a simple calculation reveals a whole limiting shape. The name honors Emil Gumbel; Siegrist gives this exponential-maxima derivation and the standard Gumbel distribution formulas. [ref].
Figure 1.
Centered exponential sample maxima for n equal to 1, 5, 20 and 100 approach the standard Gumbel cumulative distribution function
. Details.
For the toy delay model , , the limiting Gumbel distribution approximation to has and . Its predicted median is
compared with the exact median . The approximation is about seconds lower in this example. It is not an exact finite-sample probability distribution: the approximating Gumbel distribution assigns positive probability to negative delays, while the exact sample maximum cannot be negative.
The maximum domain of attraction of the Gumbel distribution is characterized by an exponential tail ratio on the scale of a Gumbel auxiliary function. This allows many original probability distributions to share the limiting shape, but it does not make the centering appropriate to all of them.
Huber loss Created 2026-09-24 Updated 2026-10-18
The Huber loss is quadratic near zero and linear beyond a fixed cutoff; its derivative is the clipped Huber score.
For threshold , the Huber loss is the loss function
The subtraction makes the values meet at ; the slopes also meet, so the Huber loss is continuously differentiable with Huber score as its derivative. It is a convex function, since that derivative is a monotone function. These quadratic and linear pieces define the original clipped location criterion.[ref]
Figure 1.
Huber loss and Huber score for threshold
. Original curves compare the Huber loss with and , then compare the Huber score with the linear score and . The dashed vertical lines mark . Details.
For , , , and , whereas the squared criterion at is . Increasing a standardized difference from to raises the Huber loss by , but raises the squared criterion by . The compromise preserves quadratic sensitivity to small differences while limiting the slope for large ones. This makes the Huber loss useful when ordinary observations should retain their detailed distances yet isolated outliers should exert limited pull.
For a fixed finite dataset and scale, taking large enough that every difference from the sample mean lies within recovers that sample mean. Toward the other extreme, for each fixed , as , connecting the criterion to median minimizes expected absolute loss. The normalization is essential: putting into the unscaled Huber loss gives zero everywhere, not a usable median criterion.
For the longest increasing subsequence length on a product space of independent coordinates, a witness of length uses only coordinates. Any point with subsequence length at most must differ on at least witness positions. Weights on those positions show . Thus for ,
At a median , this gives upper tail and lower tail . Integrating the tails places the mean within of the median, so the natural concentration scale near the mean is . A random permutation is represented by the ranks of independent continuous variables; arbitrary dependent sequences need not obey this conclusion.
Influence function Created 2026-09-24 Updated 2026-10-14
An influence function asks how much a population answer moves when an infinitesimal fraction of its probability distribution is relocated to a specified point. It distinguishes the unbounded response of the mean from the bounded response of the median and the Huber location estimator. The normal-location influence curves and finite contamination bias of normal location below make that difference quantitative.
Let be a real-valued statistical functional, a reference probability measure, and the Dirac measure concentrated at . Along the epsilon-contamination neighborhood path , define the right derivative
The name influence curve refers to the same object. The derivative is in the signed direction , so the calculation removes baseline mass as well as adding a Dirac measure. The definition is a limit for each fixed ; it does not automatically give a remainder uniform over arbitrarily distant .[ref]
The statistical functional must be defined on these contaminated probability measures, and the right derivative must exist and be finite. For a mean, a finite first absolute moment suffices. For a median, require a unique baseline median and a probability density function continuous and strictly positive there. For a smooth M-estimator, require an isolated population root, justified differentiation of its expected value, and a nonzero derivative with respect to the fitted parameter. These are specific conditions for the formulas below. Existence of the pointwise influence function alone proves neither an asymptotic linear representation nor pathwise differentiability of a statistical functional; each needs control of its own remainder and admissible statistical paths.