Anderson–Darling test Created 2026-10-14 Updated 2026-10-18
The test rejects for large values of this tail-weighted empirical discrepancy. For a specified continuous null, its standard limiting statistic is , using a Brownian bridge. The reciprocal variance weight gives tail deviations more influence than the Cramér–von Mises criterion. If null parameters are estimated, fitting must be included when computing or simulating its reference law.
Empirical distribution function Created 2026-09-24 Updated 2026-10-18
The empirical distribution function counts the fraction of observations at or below a threshold. For a statistical sample of real observations , defineEach indicator function contributes one exactly when its observation is counted. Equivalently, , where the empirical measure assigns probability mass to each observation, including repeated observations.[ref]
Choose the illustrative statistical sample . Its empirical distribution function isFor example, counts both observations equal to , , and . There is no observation at , so there is no jump there. The five observations produce only four distinct jump locations.
The convention makes the empirical distribution function right-continuous: once a threshold reaches an observation, that observation remains counted immediately to its right. For a finite statistical sample, the count is constant from any up to the next larger observed value, proving right continuity. Its left-hand limit counts observations strictly below , soA value occurring times causes one jump of size . At the jump is ; at , , and each jump is . All jumps sum to one. Thus the empirical distribution function is a nondecreasing step function with limits zero and one, and is itself a valid cumulative distribution function.
This turns many questions about data into simple cumulative distribution function operations. The observed fraction in is : for it is , counting and but excluding both s. Including the left endpoint gives . A sample quantile reads the same staircase in reverse: the smallest threshold reaching is . Unlike a histogram, this representation requires no choice of bins; its jumps retain every observation and its multiplicity.
The exact description of a finite statistical sample must be distinguished from a statistical model for how it was obtained. The empirical distribution function is defined for any finite list, with no independence assumption. Once the list is observed, its counts are fixed. For statistical inference, one often models as independent and identically distributed random variables with an unknown population cumulative distribution function . Then describes the sampling law, while varies across repeated statistical samples. The value is an observed fraction and an estimate of ; it does not establish that the population probability is . Even when is continuous, every finite is discrete.
For any threshold fixed before sampling, the indicator functions are independent Bernoulli random variables with success probability . Therefore the count has a binomial distribution andThe expected value follows by adding the expected values of the indicator functions; the variance follows by adding their variances using independence and dividing by . Thus is an unbiased estimator of at a fixed threshold. Controlling the error at every threshold at once requires more than a fixed-threshold calculation: the DKW inequality supplies such control, and the Glivenko-Cantelli theorem describes its uniform convergence almost surely as grows.
Comparing with a proposed cumulative distribution function also motivates goodness-of-fit tests, including the Kolmogorov-Smirnov test, the Anderson–Darling test, and the Cramér–von Mises criterion. A standard Kolmogorov-Smirnov test calibration assumes a fully specified continuous population law; fitting its statistical parameters from the same statistical sample changes that calibration.[ref]
1.3.5.16. Kolmogorov-Smirnov Goodness-of-Fit Test. NIST and SEMATECH e-Handbook of Statistical Methods; Characteristics and Limitations, items 1 and 3; Definition, test statistic and fully specified distribution requirement
Past exam of the mathematics course of the University of Cambridge 2005 iii Paper 42 6 vii Solution Created 2026-10-03 Updated 2026-10-14
For a fully specified continuous null distribution , compare the empirical distribution function with . The probability integral transform makes iid uniform under the null, giving distribution-free calibration. Three common discrepancies areThese define the Kolmogorov-Smirnov test, Cramér–von Mises criterion and Anderson–Darling test, respectively. Reject for large values. The supremum detects the largest discrepancy, the unweighted integral combines discrepancies throughout the distribution, and the reciprocal weight emphasizes the tails.
The Donsker theorem for empirical distribution functions gives for a Brownian bridge , with covariance . Consequently the standard continuous-null limits are , , and for , respectively; the weighted last limit also requires control near the endpoints. Exact finite-sample or asymptotic null quantiles provide critical values.
If parameters in are estimated from the same observations, these fully specified-null critical values generally fail. A first-order expansion isso the estimated parameter changes the limiting process. One must use the fitted-model null law, adjusted asymptotic theory, or a parametric bootstrap that re-estimates the parameters in each replicate.
