Nonparametric statistics Created 2026-09-24 Updated 2026-10-14
Nonparametric statistics studies statistical inference without restricting the unknown probability distribution or target function to a fixed finite-dimensional parametric statistical model. In density estimation and nonparametric regression, the number of features that an estimator can represent may grow with the sample size. Rank tests offer another approach: the probability distribution of their test statistic under the null hypothesis can be obtained without specifying the common continuous probability distribution.
"Nonparametric" does not mean free of assumptions or tuning choices. A kernel density estimator still requires a kernel for density estimation and a smoothing bandwidth, and its interpretation depends on assumptions about the statistical sample. The freedom is useful when a prescribed shape, such as a single normal distribution, would hide features that the observations might reveal.
Let a group act on the sample space. A statistic is a maximal invariant when it is invariant and separates group orbits:
Together these conditions say that exactly when and belong to the same orbit.
The basic result is that invariant tests factor through a maximal invariant. Specifically, a test function is invariant exactly when it can be written . To prove the nontrivial direction, define for any representative with . Two representatives are in the same orbit by maximality, and invariance gives them the same test value, so is well-defined. Conversely proves invariance. Measurability is taken on the quotient statistic space; for the finite rank spaces used below it is automatic.
If a null family is transitive under the group action, the null law of is parameter-free. Indeed, if is the law of when , then for every measurable set ,
Thus invariant procedures use exactly the information in , and its common null law calibrates tests without estimating the transformed nuisance distribution. This explains the role of maximal invariants in nonparametric statistics.
For simultaneous strictly increasing bijections of the real line, the labeled ranks of observations are a maximal invariant on samples without ties. Increasing maps preserve every comparison. Conversely, two such samples with the same ranks can be matched by a piecewise linear increasing bijection through their corresponding ordered observations, extended with positive-slope tails. This proves ranks as a maximal invariant under increasing transformations. Under independent sampling from any common continuous distribution, every labeled ordering is equally likely by exchangeability. Hence rank tests have distribution-free null calibration even without a global transitivity assertion for the entire class of continuous distributions.
On samples of distinct real observations, the labeled rank vector is a maximal invariant for simultaneous strictly increasing bijections of the real line. Such transformations preserve every comparison. Conversely two samples with the same ranks can be matched by a piecewise linear increasing bijection through their corresponding ordered observations, with positive-slope tails. Under a common continuous probability distribution, every labeled ordering is equally likely by exchangeability, giving distribution-free rank tests. This argument does not assume that all continuous distributions lie in one orbit of real-line homeomorphisms.