A copula is a joint distribution function on a unit cube whose one-dimensional marginal distributions are uniform distributions. Applying each continuous marginal distribution to its random variable produces uniform marginals by the probability integral transform; their copula records the remaining dependence. Independent uniform coordinates and one common uniform coordinate give different copulas with the same marginals.
This goodness-of-fit criterion integrates the squared difference between the empirical distribution function and a specified continuous null distribution. Under a fully specified null, the probability integral transform makes its law distribution-free; its limiting law is for a Brownian bridge. Parameter fitting changes that calibration.
Evolutionary-state selection by stellar lifetimes Created 2026-10-06 Updated 2026-10-14
Given a birth-mass distribution and age distribution, an evolutionary state occupies the mass-age set where its starting lifetime has elapsed and its ending lifetime has not. The state number fraction is the probability measure of this set. Initial mass function tail coordinates and the probability integral transform can turn these weighted regions into simple geometric areas.
Every optimal leader bid satisfies , because bidding zero guarantees payoff zero and winning probability is at most one. Hence . With identically distributed independent continuous valuations, the probability integral transform gives . The leader's unconditional winning probability is therefore at most , even when some high leader types have a conditional advantage. This argument does not depend on selecting a unique optimum.
Inverse transform sampling Created 2026-09-24 Updated 2026-10-14
If has a uniform distribution on and is the quantile function of a cumulative distribution function , then has the desired probability distribution. Indeed, right continuity gives
so . This short argument works for both jumps and smooth cumulative distribution functions. MIT's continuous-probability notes introduce the inverse-transformation construction. [ref].
For the three-value example, send to , to , and to . These intervals have exactly the desired widths , , . For the density example, output : for , . Independent uniform draws give independent random variables after this deterministic transformation. This direction of construction works even when has jumps; applying the probability integral transform in the other direction requires its own continuity hypotheses.
For independent observations from a continuous distribution function, the probability integral transform makes the Kolmogorov-Smirnov statistic distribution-free. Choose from its uniform-sample distribution to have probability of not exceeding that critical value. Clipping the empirical distribution plus/minus this value to the unit interval gives simultaneous coverage at every argument. This is a band for the entire distribution, rather than separate pointwise intervals.
// Target: statistical-modelling.bigb
Kolmogorov-Smirnov test 2026-10-14
The one-sample Kolmogorov-Smirnov test checks goodness of fit by comparing an empirical distribution function with a specified cumulative distribution function . Its Kolmogorov-Smirnov statistic is the largest vertical gap anywhere between the two curves. Every threshold asks the same concrete question: what proportion of the observations are at or below it, and what probability does the proposed probability distribution assign there? A large discrepancy supplies evidence against the null hypothesis.
For example, four stipulated observations compared with the uniform distribution on give . Just before , only two observations have been counted, so the empirical distribution function approaches , while approaches . The Kolmogorov-Smirnov statistic section calculates every jump-side gap. These are exact illustrative numbers, not experimental measurements or a claim of statistical significance.
The ordinary one-sample calibration assumes independent and identically distributed real observations and a simple hypothesis , with a continuous function fixed before inspecting these observations. All statistical parameters of must be specified.[ref] Under that null hypothesis, the probability integral transform gives with the uniform distribution on , retaining independence. Consequently the sampling distribution of depends on the sample size , but not on the particular continuous . This is the useful sense in which the calibration is distribution-free.
For the exponential distribution of rate one, for . Take for the four stipulated above. The probability integral transform changes the horizontal coordinates but preserves both the order statistics and their cumulative heights, so the same Kolmogorov-Smirnov statistic appears on both scales. More generally, for continuous , the jump-side formulas depend only on . Strict increase everywhere is unnecessary: intervals on which is constant have probability zero under the null hypothesis. This explains the invariance without assuming a strictly positive probability density function.
Figure 1.
The probability integral transform preserves the Kolmogorov-Smirnov gap on exponential and uniform scales
. The same four stipulated points are shown as on the left and on the right. Open circles indicate left limits of the empirical distribution function, filled circles its values. The gap is approached from below the third observation on both scales. Details.
The observed Kolmogorov-Smirnov statistic is a discrepancy, whereas its p-value is a tail probability under the null hypothesis:
Here is computed from a fresh sample of the same sample size. Choose a significance level before the test and reject when the calibrated p-value is at most . The value alone supplies neither a p-value nor a rejection decision. Failure to reject does not establish that the null hypothesis is true. A finite-sample calibration and the asymptotic Kolmogorov-Smirnov theorem are distinct; a cutoff for must be rescaled before use with .[ref]
Fitting statistical parameters on the tested observations replaces by the random . The resulting transformed observations need not be independent and identically distributed uniforms, so the ordinary reference law fails. The Lilliefors test addresses a particular fitted normal distribution. More general parametric bootstrap calibration must simulate from the fitted statistical model and repeat the fitting in every replicate; holding the fitted statistical parameters fixed during those comparisons calibrates a different procedure. Such a parametric bootstrap requires its own validity justification rather than inheriting exactness from the simple-null test.
For a discrete probability distribution, is generally not uniform. Equal observations also arise from rounding, so tied data require a calibration that accounts for the discrete probability distribution or the rounding rule. The discrepancy remains meaningful, but continuous-null p-values are not automatically valid. Statistical dependence likewise changes the reference law. The two-sample Kolmogorov-Smirnov test compares two empirical distribution functions and has a different calibration.[ref]
Write for the survival function; this is the function denoted in the survival notation. For a proper continuous event-time distribution with hazard function , its cumulative hazard function is . The probability integral transform makes uniform on , including when has flat intervals: those intervals have zero event probability. Consequently
Thus the cumulative hazard probability transformation gives . No strict monotonicity of is needed on intervals that carry no event mass. The usual proper continuous survival law is essential; an atom of subjects who never fail would instead require separate treatment of the mass at infinity.
A constant number star formation rate over produces a uniform present-age distribution. The birth-age distribution under constant star formation therefore gives
Outside this age interval the cumulative distribution function is zero or one. The census here retains stellar remnants as objects, as required by the population model.
Write . The initial mass function is proportional to on . Normalizing the tail integral gives the power-law initial-mass-function tail coordinate:
For lower thresholds . Because the birth mass and formation time have independence, the probability integral transform makes uniform on the unit square. is an upper-tail coordinate, so larger masses have smaller .
A red giant of current age lies in the stellar lifetime regions in a mass-age diagram
There are no red giants below in this model. For the upper boundary is the population's age limit, while for both lifetime boundaries are present. A white dwarf lies above .
In uniform probability coordinates the main-sequence boundary is and the end of the giant phase is . The giant region is therefore , clipped to the unit square: it is the triangle with vertices . Its area, and hence the individual giant fraction, is
The white dwarf region is the triangle with vertices , giving
The remaining are on the main sequence. Boundaries have zero probability and do not affect these counts. Treating every post-giant object as a white dwarf is a stipulated toy-model assumption; real high-mass stars have other stellar remnants.
Figure 1.
Red-giant and white-dwarf regions in mass-age coordinates and their triangular images in uniform tail-mass and age coordinates
. Details.
For the binary calculations, use a coeval binary population: components share their birth time even though their birth masses are independently drawn and their subsequent evolution is independent. Hence is uniform in the unit cube. At a fixed age coordinate , a component is a giant when , and a white dwarf when . Define the conditional state fractions
Components have conditional independence given ; averaging over the common age must be done after forming the conditional pair probabilities. The continuous-birth binary state fractions below are consequently volumes in this cube, not products of the marginal single-star fractions.
For , the probability integral transform makes iid uniform on . Continuity of is enough; strict increase is unnecessary. Their extreme order statistics have joint density
choose the observations giving the two extremes and put the remaining between them. Transform to and integrate from zero to . The uniformized sample range therefore has
Equivalently . For , the range is identically zero instead.
The exact failure probability is
Thus the exact integer sample size is the least making this quantity at most . For with , it tends to . This function decreases strictly from one to zero on positive , because its derivative is . For there is therefore exactly one positive solution of
This gives the extreme-order-statistic tolerance interval sample-size rule
When is small, , so a useful first refinement is . This is an approximation, not an exact integer guarantee; use the preceding exact failure probability to check rounding and very stringent tail requirements. The interval here encloses population content, rather than estimating a fixed distribution parameter.
The empirical distribution function is . For continuous F, the probability integral transform gives independent uniform variables . Strict increase of F is unnecessary. More explicitly, generate the observations by with the generalized quantile inverse. Then , so , where is the uniform empirical distribution.
Continuity and the limits of F ensure that its range contains . The endpoint discrepancies for are zero. Hence
which depends only on n. Equivalently it is , a function of uniform order statistics. This proves the distribution-free property of the Kolmogorov-Smirnov statistic even when F has flat portions.
Choose from this common distribution so that . The Kolmogorov-Smirnov confidence band is
The event that all these inequalities hold is exactly the event used to choose the critical value, giving simultaneous coverage . The Glivenko-Cantelli theorem states that for an independent identically distributed sample from any distribution function, continuous or not, almost surely.
For an integrable r-argument U-statistic kernel, replace it by . Every permutation has the same expectation by exchangeability, so this symmetrization of a U-statistic kernel preserves the target functional. For a symmetric U-statistic kernel h and , the U-statistic is
Each summand has expectation theta, hence the statistic is unbiased.
For the population variance, use . Independence gives when the second moment is finite. The corresponding statistic simplifies using :
Thus variance as a U-statistic is precisely the usual unbiased sample variance, for .
Let . Under the symmetric continuous null hypothesis, positive and negative signs have probability and zeros have probability zero. For the sign test, take and reject for small values: under the null. Choose with ; randomization at the next value attains exact size if desired. The lower tail is appropriate for .
For the Wilcoxon signed-rank test, rank increasingly and put . Continuous observations have no absolute-value ties almost surely. Conditional on the absolute values, the signs are independent fair signs because symmetry makes the sign independent of magnitude. Hence has the distribution of for independent Bernoulli random variables with parameter . Again reject in the lower tail, using this exact subset-sum distribution or a normal approximation. Independence gives the requested null moments:
For a symmetric kernel of fixed order , a one-sample U-statistic is . State the U-statistic central limit theorem: if , , and , then . The nondegeneracy condition is important.
For , its order-two U-statistic satisfies the exact Wilcoxon signed-rank statistic identity
To prove it, in an unordered pair the sign of the sum is the sign of whichever observation has larger absolute value. Counting the pairs for which a positive observation is larger contributes its rank minus one; its own positive-sign indicator supplies the remaining one.
Write for the distribution function of under the null. Symmetry gives and
The probability integral transform makes uniform on , so . Therefore . The centred is and is negligible on the scale of . Combining the exact decomposition and its mean gives
The lower-tail approximate level- rejection rule compares this standardized statistic with ; a half-unit continuity correction can refine discrete-tail calculations.
For a fully specified continuous null distribution , compare the empirical distribution function with . The probability integral transform makes iid uniform under the null, giving distribution-free calibration. Three common discrepancies are
These define the Kolmogorov-Smirnov test, Cramér–von Mises criterion and Anderson–Darling test, respectively. Reject for large values. The supremum detects the largest discrepancy, the unweighted integral combines discrepancies throughout the distribution, and the reciprocal weight emphasizes the tails.
The Donsker theorem for empirical distribution functions gives for a Brownian bridge , with covariance . Consequently the standard continuous-null limits are , , and for , respectively; the weighted last limit also requires control near the endpoints. Exact finite-sample or asymptotic null quantiles provide critical values.
If parameters in are estimated from the same observations, these fully specified-null critical values generally fail. A first-order expansion is
so the estimated parameter changes the limiting process. One must use the fitted-model null law, adjusted asymptotic theory, or a parametric bootstrap that re-estimates the parameters in each replicate.
The continuity of the cumulative distribution function gives the probability integral transform: is uniform on . Strict monotonicity or a probability density for is not required. Since is nondecreasing,
By independence, for , so has probability density function . Average the conditional probability in part (b) using this distribution:
Thus . The expression telescopes to total mass one, so the waiting time is finite almost surely.
Let . The Kolmogorov-Smirnov statistic is , often reported as . Under the simple null, the probability integral transform makes independent uniform variables on . Strict monotonicity and continuity identify the empirical distribution under this change of coordinates, so
Its null law is therefore independent of .
For the composite null, the joint density is . Its parameter dependence is only through , proving sufficiency by the Fisher-Neyman factorization theorem; the larger statistic is sufficient too. Ties have probability zero. For fixed , the density of is , , because the other coordinates range independently over . Dividing the joint density by this marginal gives conditional density
Thus the remaining observations are conditionally independent .
For , discard the maximum and apply the Kolmogorov-Smirnov test to the ratios , , against . Use the ordinary null critical values for sample size . Its conditional, hence unconditional, level is independent of . Keeping the fitted maximum and using the ordinary -sample critical values would not have that justification.
Put for . This is the quantile function, rather than an ordinary inverse requiring strict increase. The limits of the distribution function at infinity make finite, and the fact that is a right-continuous function ensures . Consequently
Increasing shrinks the set in the infimum, so the quantile function is a monotone function. To prove the left continuity of the quantile function, fix and let . If , choose . Then , so some satisfies , a contradiction. Thus as . At a flat stretch of the distribution function, the quantile function may jump immediately to the right, consistent with this left-continuous convention.
For the uniform order statistic, count the observations at most . That count has the binomial distribution with parameters , giving
Differentiating makes adjacent terms telescope: use and . The probability density function is therefore
In particular, has the Beta distribution with parameters .
Write for the specified median. Continuity of the distribution function gives and no mass at , even if the distribution function has a flat stretch there. Thus has the binomial distribution with parameters . Except on a null event, the order-statistic confidence interval for a median covers exactly when . Symmetry of the binomial distribution makes its two failure probabilities equal. Alternatively, the probability integral transform gives
Hence the coverage is exactly , with
The asymmetric open/closed endpoint convention does not change the coverage because the continuous probability distribution assigns no mass to the median.
Use the usual continuous-distribution convention , , and write . After observing , the follower can win by matching it, because ties favor the follower. Its best response is to match when and choose zero when ; the indifferent equality has probability zero. Thus the leader wins with probability and a leader of type maximizes
Bids above are dominated by bidding . This is the leader optimization in a sequential private-value all-pay contest. Since is a concave function, is concave. An interior optimum satisfies , with the usual endpoint conditions when that equation has no interior solution.
For precision, select the smallest maximizer when the leader is indifferent. This defines a Stackelberg equilibrium and supplies the printed strict conditional comparison at the threshold type. Let . The density is positive: if it vanished there, its nonnegative nonincreasing continuation would force to remain up to , which is impossible. At the median,
If this is positive, every maximizer is strictly greater than , so the leader wins with probability greater than . If it is negative, every maximizer is strictly smaller than . If it is zero, is a maximizer, and the smallest maximizer is at most . Therefore the median-density threshold for the leader in an all-pay contest is
Strict concavity of would make the optimum unique, removing the selection convention. With mere concavity, the printed assertion needs that convention at equality. For example, and make all bids optimal, and choosing makes the leader more likely to win even though the strict threshold is not exceeded.
The same issue can occur at an interior type, rather than just an endpoint. A continuously differentiable concave distribution is
Its density decreases from to , is constant on , and then decreases to ; integration gives . Its median is . At , every bid in maximizes , and choosing gives winning probability . This confirms the genuine best-response selection at a flat leader objective issue. The smallest-maximizer convention avoids it; the threshold type has zero ex ante probability.
The unconditional comparison is valid for every optimal selection. Zero effort guarantees the leader payoff zero, so an optimal bid satisfies
Consequently . If has the continuous distribution , the probability integral transform makes uniform on . Taking expectations proves the ex ante follower advantage in a sequential all-pay contest:
For strictly increasing atom-free , optimal bids in fact satisfy for almost every , so the first inequality is strict. Conditional advantage for unusually high leader types is therefore compatible with an unconditional follower advantage.
Continuity of the cumulative distribution function gives the probability integral transform: is uniform on . Hence is also uniform, and the cumulative hazard probability transformation gives
Thus
The exponential distribution has rate and mean one here. This proof does not require a strictly increasing cumulative hazard: intervals with zero density carry no probability mass. It assumes a proper continuous finite survival time, without an atom at infinity.
Let and let denote present stellar age, rather than time measured from the galaxy's birth. With a fixed initial mass function, constant star formation rate also gives a constant number of births per unit time, as in the birth-age distribution under constant star formation. Counting the supplied stellar evolution model's remnants as part of the population, ages have a uniform distribution on . Integrating the constant birth rate therefore gives
Outside this interval the cumulative fraction is zero or one as appropriate.
Write for the birth-mass parameter and . The normalization cancels when integrating the initial mass function:
Thus the mass-tail fraction is
It is one at and below the lower cutoff. The normalization constant has no effect on any number fraction.
For evolutionary-state selection by stellar lifetimes, a red giant has completed its main sequence lifetime but not its giant lifetime. Its stellar lifetime regions in a mass-age diagram are bounded by
The lower boundary meets at and the upper boundary meets it at . A white dwarf lies above the upper lifetime curve, within the same age interval.
Figure 1.
Red-giant and white-dwarf regions in the birth-mass–age plane and their triangular images in uniform mass-tail–age coordinates
. Details.
The probability integral transform, applied to the decreasing mass-tail coordinate, makes uniform on : . The independent birth age gives uniform on , so number fractions are areas in a unit square. Since , the red giant region becomes , a triangle with vertices , and . Its area is . The white dwarf region is a triangle of area . Hence the present individual-star fractions are
The rest are on the main sequence under the given toy lifetime model.
For the binary stars, draw two independent mass-tail coordinates , but only one shared age coordinate : components born together are coeval. The coeval binary population therefore occupies a uniform unit cube . At a fixed age , the state probabilities for either component are
Their evolutionary states have conditional independence given . They generally do not have unconditional independence, because sharing an age correlates their states. The binary fractions below are slice areas averaged over .
An exact finite mixture model follows from the binomial theorem:
Define positive mixture weights
Here is the Beta function, so the component probability distributions are . All coefficients are computable from the observed integer counts.
Use inverse transform sampling with the supplied to choose : writing and , take . Then recycle its position inside that interval,
Recycling a uniform random variable after discrete sampling makes uniform independently of , since . It is also independent of all supplied random variables with gamma distributions. Transform these by the probability integral transform:
They are independent random variables with uniform distributions because has a unit-rate exponential distribution.
Conditional on , put and . Form the values and return their th order statistic. This uses at most the supplied random variables with gamma distributions, since . The uniform order statistic formula gives
Averaging these component probability density functions with weights recovers exactly the normalized posterior density. Unused inputs can be discarded. When , , , and the output is , as required. Interval endpoints and ties have probability zero; any consistent convention there is harmless. Exactness here concerns the mathematical algorithm; finite-precision arithmetic can be stabilized with logarithmic mixture weights.