Kaplan–Meier estimator Created 2026-09-24 Updated 2026-10-14
At distinct observed event times , let be the risk set size immediately before , and let count events at . The Kaplan–Meier estimator of the survival function is
The empty product is one. Each factor estimates a conditional survival probability among those still observed and event-free; their product joins the successive steps. This is nonparametric statistics: no specified shape for the survival distribution is imposed. Use independent censoring and the appropriate risk sets to interpret the result as an estimate for the intended population.
The Kaplan–Meier estimator is a right-continuous function with downward jumps at event times. Right censoring changes later denominators without causing a jump. A tick on the curve marks right censoring, rather than a failure. For a tied group of events, use the one factor ; subjects right-censored at that recorded time remain in for this factor. The fraction estimates a discrete hazard, not a continuous hazard function in inverse-time units. With no censoring, the factors telescope to the fraction of the original cohort whose observed survival times exceed , the complement of its empirical distribution function.
Edward L. Kaplan and Paul Meier published [ref]. Their paper addresses lifetime estimation when observation ends before failure and explicitly calls attention to the assumption of independence between lifetime and potential observation loss. The date 1958 is the original publication year; the publisher's later online-posting date is not the discovery date.
In his [ref], Kaplan traces Meier's interest to cancer-duration data in 1952 and his own to the lifetimes of vacuum tubes in undersea telephone-cable equipment a year later. The journal encouraged them to combine their manuscripts. The shared mathematical question was how to estimate a survival function when some lifetimes are still running or disappear from observation.
Use the usual two mutually independent samples, and rank their pooled observations increasingly. Continuity gives no ties with probability one. Let be the pooled rank of and define the Wilcoxon rank sum test statistic
The last identity counts the ranks contributed by the other sample after subtracting the within- ranks.
When , the observations are stochastically smaller, so reject for small , equivalently small . For instance,
The inequality follows from and for continuous . A common-uniform quantile coupling also makes this direction transparent: , and is nondecreasing in each .
Under the common-distribution null hypothesis, the pooled observations are exchangeable. Every selection of ranks for the labels has probability . Thus the exact null law is
Choose a lower-tail critical value with probability at most the desired size, optionally randomizing at its boundary to attain the size exactly. This law is independent of the unknown common distribution. Common increasing transformations leave the pooled ranks of observations unchanged, so the statistic is a function of the maximal invariant from part (i). Although a rank sum is not itself maximal, it is an invariant test statistic. These facts justify the test within nonparametric statistics.
Sampling ranks without replacement gives
so with the same variance. For with , the normal approximation for a rank sum states
Equivalently replace by . The large-sample one-sided test rejects when this standardized statistic is below the lower normal distribution quantile. This is the two-sample rank-sum test, rather than the paired Wilcoxon signed-rank test.
Let a group act on the sample space. A statistic is a maximal invariant when it is invariant and separates group orbits:
Together these conditions say that exactly when and belong to the same orbit.
The basic result is that invariant tests factor through a maximal invariant. Specifically, a test function is invariant exactly when it can be written . To prove the nontrivial direction, define for any representative with . Two representatives are in the same orbit by maximality, and invariance gives them the same test value, so is well-defined. Conversely proves invariance. Measurability is taken on the quotient statistic space; for the finite rank spaces used below it is automatic.
If a null family is transitive under the group action, the null law of is parameter-free. Indeed, if is the law of when , then for every measurable set ,
Thus invariant procedures use exactly the information in , and its common null law calibrates tests without estimating the transformed nuisance distribution. This explains the role of maximal invariants in nonparametric statistics.
For simultaneous strictly increasing bijections of the real line, the labeled ranks of observations are a maximal invariant on samples without ties. Increasing maps preserve every comparison. Conversely, two such samples with the same ranks can be matched by a piecewise linear increasing bijection through their corresponding ordered observations, extended with positive-slope tails. This proves ranks as a maximal invariant under increasing transformations. Under independent sampling from any common continuous distribution, every labeled ordering is equally likely by exchangeability. Hence rank tests have distribution-free null calibration even without a global transitivity assertion for the entire class of continuous distributions.
Smoothing bandwidth Created 2026-10-05 Updated 2026-10-14
A smoothing bandwidth determines the scale over which a regression kernel averages data, or a kernel for density estimation spreads each observation. It has the same units as the observations. In kernel density estimation, changing changes the visible detail while preserving the total integral one. For a Gaussian density kernel, each bump has standard deviation and its individual contribution has peak height .
If the smoothing bandwidth is too small relative to the spacings in a statistical sample, the kernel density estimator shows narrow spikes tied to individual observations: apparent peaks may be sampling accidents. If it is too large relative to features of the unknown probability density function, it blurs distinct groups together and spreads fitted probability far from the observations. An intermediate smoothing bandwidth can reveal broad structure, but visual smoothness alone cannot establish accuracy.
Figure 1.
The same sample at three Gaussian bandwidths, and leakage below zero for a separate positive sample
. Details.
The first three panels use exactly with smoothing bandwidths , and , respectively. Every curve has area one; the two groups in the observed statistical sample become less distinct as increases. No true probability density function is specified in this illustration, so the middle panel is illustrative, not a certified optimal fit. The fourth panel uses and to illustrate boundary bias of a kernel density estimator.
For a fixed nonnegative kernel for density estimation with finite squared integral, a probability density function that is bounded and continuous at an interior point with , and a deterministic sequence , the pointwise sampling variance obeys
Thus decreasing the smoothing bandwidth increases the leading sampling variance while reducing interior smoothing bias of an estimator: this is a bias-variance tradeoff. The conditions and express two goals, increasingly fine resolution and enough observations contributing locally. Practical methods such as plug-in bandwidth selection use the data to choose ; pointwise optimal kernel bandwidth depends on local features of the unknown probability density function. The smoothing bandwidth remains a tuning choice in nonparametric statistics, and knowing the support of a probability distribution can require more than a width adjustment near a boundary.
A bound on does not give the same bound on . Even independent standard normal random variables each have uniformly bounded tails while their Gaussian maximum over indices grows at scale . This distinction matters in nonparametric statistics when a shrinking bandwidth permits many spatial windows.