The quantile function converts a cumulative probability level into a value. For a cumulative distribution function and , use the generalized inverseIt selects the first threshold reaching the requested level. The infimum handles jumps and flat portions, so this construction does not require an ordinary inverse function. Other endpoint conventions are possible at or ; the open probability interval avoids those issues. NIST introduces the inverse-direction question as the percent point function. [ref]
https://itl.nist.gov/div898/handbook/eda/section3/eda362.htm. NIST: cumulative distribution and percent point functions
.For the finite example under probability distribution,Thus , , . The value at is still zero, because already reaches that level. For on , the quantile function is , giving .
A median is a central threshold; supplies one, though a median need not be unique. The same quantile function becomes a sampling algorithm through inverse transform sampling. Jumps in become flat bands in , precisely the mechanism needed to assign positive probability to one outcome.
For an integrable real random variable with distribution function , the generalized inverse sends a uniform random variable on to the distribution . This follows from if and only if . Equality of laws proves both the expectation formula and absolute integrability of the quantile. Atoms and flat pieces of cause no problem.
The probable error is the half-width of an interval around a specified central value containing probability . For a normal distribution with , its quantile function giveswhere is the standard normal cumulative distribution function and is the standard deviation. The factor is specific to the normal distribution. The centered Cauchy distribution with parameter has probable error , despite having no finite variance. Thus a central probability width need not require a finite second moment.
For , the sample quantile is the generalized inverse of the empirical distribution function: . With ordered observations this is , including ties. If the population probability density function is continuous and positive at its unique th quantile, the centered quantile has asymptotic variance under scaling by .
The quantile function is finite at every probability strictly between zero and one, but need not be finite at one. For any unbounded-above normal distribution, for every real , so its generalized inverse at one is . Inverse transform sampling still produces a real random variable almost surely because a continuous uniform distribution puts zero mass at that endpoint. A real-valued implementation may discard endpoint draws or assign an arbitrary finite value there without changing the sampled law.
For , , the quantile function is a monotone function and is left-continuous. The distribution function is right-continuous, giving exactly when . If , a point between them has and contradicts this equivalence for some . A jump just to the right of is possible when is flat on an interval.
If is the quantile function of an absolutely continuous probability distribution with probability density function , then for almost every . Gaps in the support may give jumps in , so the identity concerns its ordinary almost-everywhere derivative. It follows by differentiating the inverse relation to the cumulative distribution function.
If has a uniform distribution on and is the quantile function of a cumulative distribution function , then has the desired probability distribution. Indeed, right continuity givesso . This short argument works for both jumps and smooth cumulative distribution functions. MIT's continuous-probability notes introduce the inverse-transformation construction. [ref]
https://ocw.mit.edu/courses/9-07-statistics-for-brain-and-cognitive-science-fall-2016/6dcc172f428fbfbded912ca8862ea340_MIT9_07F16_lec3.pdf. MIT 9.07, inverse transformation method
.For the three-value example, send to , to , and to . These intervals have exactly the desired widths , , . For the density example, output : for , . Independent uniform draws give independent random variables after this deterministic transformation. This direction of construction works even when has jumps; applying the probability integral transform in the other direction requires its own continuity hypotheses.
For positive mixture weights summing to one, set and choose when , where has a uniform distribution. Then has a uniform distribution independently of : for , . This permits exact finite mixture model sampling with a recycled continuous random variable.
If at every continuity point of , then the generalized inverses satisfyat every continuity point of . Since a monotone function has only countably many discontinuities, evaluating all quantiles at one uniform random variable gives an almost-sure coupling of the corresponding convergence in distribution.
Articles by others on the same topic
There are currently no matching articles.
