For a fully specified continuous null distribution , compare the empirical distribution function with . The probability integral transform makes iid uniform under the null, giving distribution-free calibration. Three common discrepancies are
These define the Kolmogorov-Smirnov test, Cramér–von Mises criterion and Anderson–Darling test, respectively. Reject for large values. The supremum detects the largest discrepancy, the unweighted integral combines discrepancies throughout the distribution, and the reciprocal weight emphasizes the tails.
The Donsker theorem for empirical distribution functions gives for a Brownian bridge , with covariance . Consequently the standard continuous-null limits are , , and for , respectively; the weighted last limit also requires control near the endpoints. Exact finite-sample or asymptotic null quantiles provide critical values.
If parameters in are estimated from the same observations, these fully specified-null critical values generally fail. A first-order expansion is
so the estimated parameter changes the limiting process. One must use the fitted-model null law, adjusted asymptotic theory, or a parametric bootstrap that re-estimates the parameters in each replicate.
The empirical distribution function is
If is a standard Brownian motion on , the standard Brownian bridge is . It is a centred Gaussian process with continuous paths, endpoints zero, and covariance
The F-Brownian bridge is the time-changed Gaussian process . Its covariance is , exactly the covariance of the empirical distribution process .
The Donsker theorem for empirical distribution functions states that for every cumulative distribution function ,
Thus this is a function-space central limit theorem, not merely convergence of each finite collection of evaluations. The limit is a tight centred Gaussian process. No continuity of is required for this statement; a jump of can give a jump of .
For precision, is generally nonseparable, and the finite-sample process need not be a Borel-measurable random element for its norm topology. The displayed convergence in distribution has the usual empirical-process interpretation: for every bounded continuous real functional , the outer expectation and inner expectation of converge to . The outer expectation is the infimum of expectations of measurable majorants, and the inner expectation is its negative applied to . For measurable real statistics this gives ordinary convergence in distribution. The limit is tight and separably supported: maps the separable space of continuous bridge paths continuously into .
The map is Lipschitz, since
Consequently the continuous mapping theorem applied to the Donsker theorem for empirical distribution functions gives . The statistic on the left is measurable: both and are right-continuous, so its supremum equals the supremum over rational .
If is continuous, its limits at and are zero and one. The intermediate value theorem therefore shows that contains , even when is not strictly increasing. A continuous Brownian bridge is zero at its endpoints, so pathwise
We obtain the Kolmogorov-Smirnov theorem in the required form:
Continuity of is what makes the limit independent of the unknown cumulative distribution function.
Choose with . The law of has no atoms. For example, the Brownian reflection principle and conditioning a Brownian motion on its endpoint give for : the reflected endpoint density at zero is the normal density at , divided by its value at zero. Hence both one-sided maxima have continuous laws, and an atom of would require an atom of one of them. Also , since is nondegenerate. Thus such quantiles give the desired limiting coverage.
An asymptotic simultaneous confidence band is
Indeed, because , the event that for every is precisely . Its probability tends to . This is simultaneous coverage over all real , rather than separate pointwise confidence intervals.
A real functional is Hadamard differentiable at if there exists a continuous linear functional such that, whenever , and in the normed vector space,
If is defined only on a subset, require to lie in its domain. The variation of the directions is essential: convergence along each fixed direction alone is a weaker differentiability condition. Tangential Hadamard differentiability restricts the limit directions to a specified subspace; here the derivative is defined on all of .
We prove the functional delta method using compact sets, so do not need an unjustified application of the Skorokhod representation theorem on an arbitrary nonseparable normed vector space. As usual for function-space convergence in distribution, the limiting random element is tight, and the real statistics are measurable, or convergence is understood through outer expectations. These are automatic under the usual separable complete random-element formulation; the empirical-process formulation used below has a tight separably supported limit.
For put
Hadamard differentiability says for every convergent sequence of directions, since continuity gives . It implies a Hadamard remainder near a compact set: for every compact and there are and such that
To prove it, suppose it failed. Choose and at distance less than from with . Choose with . A subsequence of converges by compactness, so the corresponding converge too. The defining derivative limit contradicts the lower bound on .
Now let and . Given , tightness of a probability measure provides a compact with . For the open -neighbourhood , the Portmanteau theorem gives
On the preceding uniform remainder is less than for all sufficiently large . Consequently . Since is arbitrary, this remainder tends to zero in probability. We have proved the actual expansion
Continuity of and the continuous mapping theorem give . The vanishing remainder and Slutsky theorem therefore yield
This derivation uses the derivative definition, rather than assuming a uniform Fréchet remainder over every bounded set. If outer expectations are needed, the same compact-neighbourhood argument uses outer probabilities and gives the corresponding empirical-process functional delta method.
For the statistical application, use the sample's empirical distribution function and the plug-in estimator
Here the printed denotes bounded pointwise functions with the supremum norm, namely , rather than equivalence classes modulo Lebesgue null sets. Assume Hadamard differentiability at the true and the usual measurability of the scalar estimator. The Donsker theorem for empirical distribution functions and the proved functional delta method give
No continuity of is needed for this application. Since the derivative is continuous and linear and the bridge is a centred Gaussian process, is a centred Gaussian real random variable, possibly identically zero.
Finally, a finite real weak limit ensures the required boundedness in probability. Choose so large that . Applying the closed-set part of the Portmanteau theorem to gives
Hence there is such that, for every ,
In particular the upper-tail condition in the question holds. The plug-in estimator has estimation error , even when its limiting variance is zero.