For and , independence gives the cumulative distribution function
The cumulative distribution function is zero below and one above . Differentiating on the interior gives
up to irrelevant endpoint values. There are no endpoint atoms. This maximum is an order statistic.
For , the cumulative distribution function is zero. For , integrate the normalized probability density function:
It is continuous at , increases to one, and is the cumulative distribution function of the stated Pareto distribution.
The proposed cumulative distribution function satisfies and is smooth. Its derivative is
so it is increasing and continuous, hence right-continuous. As , and ; as , and . Thus it has all the required cumulative distribution function properties, and defines the standard Gumbel distribution.
The cumulative distribution function is . In the absolutely continuous setting of a probability density function, the probability density function is a nonnegative integrable function satisfying
Thus and almost everywhere. A merely continuous cumulative distribution function need not possess a probability density function; the density assumption means absolute continuity.
Because , its cumulative distribution function is zero for . For , the transformation is decreasing, and has a continuous cumulative distribution function, so
Thus the exponential transform of a standard Gumbel variable gives
This is the exponential distribution with rate .
Write . Each exponential distribution has cumulative distribution function for . Independence therefore gives the maximum of independent exponential random variables formula
For any fixed , the threshold is nonnegative for all sufficiently large . Then
This is convergence in distribution to the standard Gumbel distribution.
In the probability density function convention used here, a random variable has a nonnegative probability density function , with , such that for every Borel set ,
In particular, its cumulative distribution function is and individual points have probability zero. More precisely, this property is the statement that the distribution is an absolutely continuous probability distribution; continuity of the cumulative distribution function alone is a weaker property and need not imply a probability density function.
Point atom of a measure 2026-10-25
A point atom is a point whose singleton is a measurable set with strictly positive measure. That singleton is an atom of a measure. This is more specific than a general atom of a measure, which is defined as a positive-measure set that cannot be divided into two measurable sets of positive measure.
For a probability measure on the Borel sigma-algebra of , a point atom at appears as a jump of its cumulative distribution function:
Continuity of probability applied to intervals approaching proves this identity. Keeping such jumps is essential when deciding whether an endpoint belongs to an integration region.
The cumulative distribution function of on is . Differentiating gives density on , which is the beta distribution probability density function with parameters . This also gives a simple instance of inverse transform sampling: to sample a density on , raise a uniform draw to the power .
Probability density function Created 2026-09-24 Updated 2026-10-25
A probability density function represents probabilities as areas under a nonnegative measurable function. For a real random variable with an absolutely continuous probability distribution, it satisfies
for every Borel set . Its height is probability per unit of the outcome variable, not the probability of that exact outcome. Thus a probability density function may exceed one, while the probability of a singleton is zero. NIST describes the interval-probability interpretation through integration. [ref].
For the example on , , but and . The cumulative distribution function is within that interval, connecting density height to the local accumulation rate.
Changing the scale changes the density height. If , then on . At the corresponding value , its height is , while is unchanged. The factor compensates for the wider integration variable. This is a change of variables, not a change in the underlying probabilities.
A probability density function is determined only almost everywhere: changing its values on a Lebesgue measure zero set changes no probabilities. The Cantor distribution has no such representation, and a mixed probability distribution can have both a point mass and a density component, so differentiating its cumulative distribution function does not recover all its mass.
Probability distribution Created 2026-09-24 Updated 2026-10-18
A probability distribution describes how the values of a random variable are allocated among possible outcomes. More precisely, the law of a random variable assigns each measurable set the probability
It is a probability measure on the values of . The underlying experiment can be more elaborate than the output: different experiments may produce the same probability distribution. The law of a random variable retains the probabilities needed to answer questions about that output. [ref].
For a finite example, let take values with probability mass function , , . Its probabilities sum to one. The event has probability , whereas has probability : including one endpoint matters when it carries positive probability.
For a contrasting random variable , choose the probability density function on , and zero elsewhere. It integrates to one. Now , while every single outcome has probability zero. The probability density function can have height : probabilities come from integrals over outcome ranges.
Figure 1. . Left: takes values with probability masses , so its cumulative distribution function jumps at those values; open and filled markers show the excluded and included heights at a jump. Right: has probability density function on the interval and cumulative distribution function there. The shaded integral over and the corresponding cumulative distribution function increase both equal . Details.
The cumulative distribution function answers all threshold questions for a real random variable, regardless of whether there are jumps or a probability density function. A quantile function reverses the direction of the question: given a cumulative probability level, find a threshold. This connects descriptive summaries to inverse transform sampling, which constructs a chosen probability distribution from a uniform distribution.
Probability integral transform Created 2026-10-05 Updated 2026-10-06
If has a continuous cumulative distribution function , then has the uniform distribution on . Combined with inverse transform sampling, this constructs the monotone rearrangement to a target with quantile function .
Probability mass 2026-10-14
The probability mass at an outcome is the probability of its singleton, . It equals the jump of the cumulative distribution function. For a discrete probability distribution these masses form the probability mass function; a continuous probability distribution gives every individual outcome mass zero. Positive probability mass at a point is distinct from the height of a probability density function.
Probability mass function Created 2026-09-24 Updated 2026-10-14
For a discrete probability distribution, the probability mass function of its random variable is
The sum ranges over its finite or countable set of possible values. An event's probability is the sum of the masses of the included values. For the example under probability distribution, . The cumulative distribution function sums masses below a threshold; its jump at a value equals that value's probability mass. This differs from a probability density function, whose height is not a point probability.
If is the quantile function of an absolutely continuous probability distribution with probability density function , then for almost every . Gaps in the support may give jumps in , so the identity concerns its ordinary almost-everywhere derivative. It follows by differentiating the inverse relation to the cumulative distribution function.
Quantile function Created 2026-09-24 Updated 2026-10-14
The quantile function converts a cumulative probability level into a value. For a cumulative distribution function and , use the generalized inverse
It selects the first threshold reaching the requested level. The infimum handles jumps and flat portions, so this construction does not require an ordinary inverse function. Other endpoint conventions are possible at or ; the open probability interval avoids those issues. NIST introduces the inverse-direction question as the percent point function. [ref].
For the finite example under probability distribution,
Thus , , . The value at is still zero, because already reaches that level. For on , the quantile function is , giving .
Figure 1.
Quantile functions map probability levels to outcomes, including repeated outcomes
. Left: the three probability bands of widths , and map to outcomes , and . Right: the quantile function maps the same probability levels to the continuous density example. The marked levels are , and . Endpoints at and are shown open because the stated quantile function convention uses . Details.
A median is a central threshold; supplies one, though a median need not be unique. The same quantile function becomes a sampling algorithm through inverse transform sampling. Jumps in become flat bands in , precisely the mechanism needed to assign positive probability to one outcome.
For a cumulative distribution function , let , . Right continuity gives exactly when , including at atoms. Thus applying to independent uniform variables constructs an independent sample with distribution function . Its empirical distribution function is , where is the uniform-sample empirical distribution function. Consequently . For the uniform sample, monotonicity and a grid of mesh bound the last supremum by the largest error at grid points plus . The strong law of large numbers on the countable union of all such grids proves the almost-sure limit. This construction proves the theorem for distributions with atoms as well as continuous distributions.
Random variable Created 2026-09-24 Updated 2026-10-14
A real-valued random variable is a measurable function from a probability space to the real numbers with their Borel sigma-algebra. More general targets give random elements. For every Borel set , measurability ensures that is an event, so the question "does the observed value lie in ?" has a defined probability.
The function is fixed; its input outcome is uncertain. This separates what we measure from how the uncertainty is modeled. A probability distribution is the resulting pushforward measure, . A cumulative distribution function, probability mass function, or probability density function describes that measure in an appropriate setting. The random variable and its probability distribution are different objects: the former also retains its relationship to other measurements on the same sample space.
For two independent uniform dice, let record their results and define and . The 36 ordered pairs are equally likely, but the resulting probability mass functions differ:
For the sum, count the diagonal of the outcome grid having total . For the maximum, subtract the pairs with both results below from the pairs with both results at most . These examples show how a deterministic function transforms a simple input probability distribution into a nonuniform output one.
Figure 1.
Different random variables on the same equally likely dice outcome space
. Details.
The corresponding expected values are and . The first follows immediately from linearity of expectation; the second follows from . Neither number must be an attainable result. An expected value describes an average under the probability measure, not a prediction that the next observation will equal it.
The distinction between a random variable and its probability distribution matters for dependence. and have the same discrete uniform distribution and are independent random variables. and a second copy of also have that same marginal probability distribution, but they always agree. Their joint probability distribution is concentrated on the diagonal; the marginals alone cannot say which relationship holds. This is why a model for several measurements must specify their joint law or an appropriate independence assumption.
Indicator random variables turn events into numbers: equals one on and zero elsewhere, and . This connects event counting with expected value and variance, and lets tools for random variables answer questions about probabilities. More complicated functions of observations can describe totals, waiting times, or estimation errors using the same framework.