Random variable Created 2026-09-24 Updated 2026-10-14
A real-valued random variable is a measurable function from a probability space to the real numbers with their Borel sigma-algebra. More general targets give random elements. For every Borel set , measurability ensures that is an event, so the question "does the observed value lie in ?" has a defined probability.
The function is fixed; its input outcome is uncertain. This separates what we measure from how the uncertainty is modeled. A probability distribution is the resulting pushforward measure, . A cumulative distribution function, probability mass function, or probability density function describes that measure in an appropriate setting. The random variable and its probability distribution are different objects: the former also retains its relationship to other measurements on the same sample space.
For two independent uniform dice, let record their results and define and . The 36 ordered pairs are equally likely, but the resulting probability mass functions differ:
For the sum, count the diagonal of the outcome grid having total . For the maximum, subtract the pairs with both results below from the pairs with both results at most . These examples show how a deterministic function transforms a simple input probability distribution into a nonuniform output one.
Figure 1.
Different random variables on the same equally likely dice outcome space
. Details.
The corresponding expected values are and . The first follows immediately from linearity of expectation; the second follows from . Neither number must be an attainable result. An expected value describes an average under the probability measure, not a prediction that the next observation will equal it.
The distinction between a random variable and its probability distribution matters for dependence. and have the same discrete uniform distribution and are independent random variables. and a second copy of also have that same marginal probability distribution, but they always agree. Their joint probability distribution is concentrated on the diagonal; the marginals alone cannot say which relationship holds. This is why a model for several measurements must specify their joint law or an appropriate independence assumption.
Indicator random variables turn events into numbers: equals one on and zero elsewhere, and . This connects event counting with expected value and variance, and lets tools for random variables answer questions about probabilities. More complicated functions of observations can describe totals, waiting times, or estimation errors using the same framework.
Sample space Created 2026-10-14 Updated 2026-10-14
The sample space is the set of outcomes represented by a probability model. One elementary outcome specifies a complete result at the level of detail the model keeps. An event is a subset belonging to the model's sigma-algebra ; it occurs when the actual outcome lies in that subset. Together with a probability measure , these form a probability space , with .[ref]
Choosing a sample space means deciding which distinctions matter. For two tosses, recording the ordered head-or-tail sequence distinguishes from ; recording only the number of heads merges them. Neither representation is automatically wrong, but the second cannot answer a question about which toss was heads. Keeping a detailed sample space and defining a random variable for the desired observation lets several questions share one model.
A sample space alone assigns no probabilities. Even writing as a Cartesian product does not establish independence: that requires a condition on the probability measure. On a finite sample space with all subsets admitted as events,
Only when all elementary probabilities are equal does this become , where the bars denote cardinality. This is the uniform distribution on a finite set, an additional modelling choice.
Sample spaces can also be infinite. For example, take , its Borel sigma-algebra, and the continuous uniform distribution. Then for , so each singleton has probability zero while . Thus an elementary outcome need not carry positive probability, and a continuous model cannot be understood by counting equally likely points. The distinction is developed in zero-probability event and countable additivity.
Sigma-algebra Created 2026-09-24 Updated 2026-10-14
A sigma-algebra on a set is a collection of subsets such that , implies , and for all implies . Thus it contains the empty set and is closed under countable intersections as well. This is precisely the closure needed to apply countable additivity without leaving the domain of a measure.
For ,
is a sigma-algebra. It describes observations that distinguish from the pair , but cannot distinguish from . The power set provides a finer sigma-algebra with all eight subsets. Both are valid; choosing a sigma-algebra records which questions the model can answer.
On the real numbers, the Borel sigma-algebra contains all open sets and everything generated from them by these operations. The Lebesgue measurable sets form a larger sigma-algebra, including all subsets of Borel null sets. Closure under countable unions accommodates constructions involving an entire sequence of observations or approximations.
The sigma-algebra generated by a collection is the smallest sigma-algebra containing all sets in that collection. The displayed intersection is over a nonempty family, since the power set is one candidate. An intersection of sigma-algebras contains the whole space and is closed under complements and countable unions, proving it is a sigma-algebra and establishing minimality.
For example, the half-lines generate the Borel sigma-algebra on the real line. They are Borel, and conversely and recover every open interval. Preimages of these half-lines similarly generate the sigma-algebra generated by a random variable.
For a real random variable on a probability space, is the smallest sigma-algebra making a measurable function into the Borel sigma-algebra on . The collection of all inverse images of Borel sets is already a sigma-algebra, since inverse images preserve complements and countable unions; this proves the displayed formula without completing any measure.
The weak topology and norm topology of a separable Banach space generate the same Borel sigma-algebra. A countable norming family makes every norm ball weakly Borel measurable, and separability makes every norm-open set a countable union of such balls. The reverse inclusion follows because the weak topology is coarser.
Wiener theorem 2026-10-14
There exists a probability measure on under which the coordinate process is standard Brownian motion, and its distribution there is unique. Construct consistent centered Gaussian finite-dimensional laws with covariance and use the Kolmogorov extension theorem. The fourth increment moment supplies a continuous modification by the Kolmogorov continuity theorem. Its independent increments and normal increment distributions are unchanged. Uniqueness follows because coordinate evaluations at rational times generate the Borel sigma-algebra of continuous-path space.