Since the form a partition of a set of the sample space, the events are pairwise disjoint and their set union is . By countable additivity of probability, followed by the definition of conditional probability,Every ratio is legitimate because each . This proves the countable law of total probability.
The probability axioms first give : apply countable additivity to and use normalization and nonnegativity. If , then is a disjoint union of events. Finite additivity, as a special case of countable additivity, givesThus a probability measure is monotone with respect to set inclusion. The difference event is measurable because the events belong to a sigma-algebra.
The probability measure maps the sigma-algebra of events into . Its probability axioms are nonnegativity, normalization , and countable additivity: for every pairwise disjoint sequence of events ,The sample space is , and specifies which subsets are events. Requiring countable additivity, rather than only its finite version, is part of the probability space definition.
The disjoint decomposition into sets uses only events in . Finite additivity and nonnegativity giveThus already follows from the two stated requirements. Equality is attained, for example, by choosing , since then . More generally it holds whenever . Neither normalization nor countable additivity is needed for this particular inequality.
The missing axiom is normalization: . The zero set function satisfies both displayed requirements but is not a probability measure, showing why this condition is essential.
The incomplete axiom needs countable additivity: for every sequence of pairwise disjoint events ,The stated two-event version implies finite additivity, but does not supply this requirement for a countably infinite collection. Together with nonnegativity and normalization, this gives the usual probability measure axioms on the sigma-algebra .
Let be the event that candidate succeeds. The countable additivity axiom adds probabilities only for mutually disjoint events. Successes of different candidates are not mutually exclusive, so replacing the probability of their union by misuses that axiom. Without disjointness one obtains only the union bound, not certainty. The same sum is the expected value of the number of successes, which also need not imply at least one.
If the ten outcomes are mutually independent events, with each success probability , all fail with probability . HenceThe independence assumption is essential. The marginal probabilities alone allow any union probability from up to ; perfectly overlapping success events give the lower endpoint and disjoint successes give the upper endpoint.
For each integer , the events , indexed by the integers , are disjoint and their union is . Therefore countable additivity gives the marginal probability mass functionThe nonnegative terms make this sum well-defined, even when the support is infinite.
Let be a finite or countable partition of a set of the sample space into disjoint events, with . For any event , the law of total probability isTo prove it, the intersections are disjoint and have union . Countable additivity and the definition of conditional probability therefore giveIt is enough that the union of the partition events has probability one. Parts of probability zero contribute zero in the intersection formula and can be omitted before writing conditional probabilities; conditioning by division on a zero-probability part would be undefined.
The events , for , are pairwise disjoint. Their union is , and the integers form a countable set. By countable additivity,Countability is the necessary justification: one cannot apply this argument to an arbitrary uncountable union of zero-probability singletons. This is a special case of countable sets have zero probability under a density.
Probability measure Created 2026-09-24 Updated 2026-10-14
A probability measure is a nonnegative, countably additive measure with total mass one. Thus , and for pairwise disjoint events ,The complement of an event has probability . The probability of a union of overlapping events needs a correction: . Counting the overlap once is the simplest instance of the inclusion-exclusion principle.
A zero-probability event need not be impossible as a member of the sample space. Under the continuous uniform distribution on , every individual point has probability zero, while the whole interval has probability one. Countable additivity applies to countable unions, not arbitrary uncountable ones; there is no contradiction.
For a measure space and , the restriction of a measure to a measurable subset is the measure on given by the displayed formula. The trace sigma-algebra consists of the measurable sets contained in . The empty-set axiom and countable additivity are inherited directly from . An associated measure on the original sigma-algebra is for ; the two constructions have different underlying measurable spaces.
Sample space Created 2026-10-14 Updated 2026-10-14
The sample space is the set of outcomes represented by a probability model. One elementary outcome specifies a complete result at the level of detail the model keeps. An event is a subset belonging to the model's sigma-algebra ; it occurs when the actual outcome lies in that subset. Together with a probability measure , these form a probability space , with .[ref]
Introduction to Probability, Statistics, and Random Processes by Hossein Pishro-Nik. §1.3.1 Random Experiments: definitions of outcome, sample space, and event; three-toss example
Choosing a sample space means deciding which distinctions matter. For two tosses, recording the ordered head-or-tail sequence distinguishes from ; recording only the number of heads merges them. Neither representation is automatically wrong, but the second cannot answer a question about which toss was heads. Keeping a detailed sample space and defining a random variable for the desired observation lets several questions share one model.
A sample space alone assigns no probabilities. Even writing as a Cartesian product does not establish independence: that requires a condition on the probability measure. On a finite sample space with all subsets admitted as events,Only when all elementary probabilities are equal does this become , where the bars denote cardinality. This is the uniform distribution on a finite set, an additional modelling choice.
Sample spaces can also be infinite. For example, take , its Borel sigma-algebra, and the continuous uniform distribution. Then for , so each singleton has probability zero while . Thus an elementary outcome need not carry positive probability, and a continuous model cannot be understood by counting equally likely points. The distinction is developed in zero-probability event and countable additivity.
Sigma-algebra Created 2026-09-24 Updated 2026-10-14
A sigma-algebra on a set is a collection of subsets such that , implies , and for all implies . Thus it contains the empty set and is closed under countable intersections as well. This is precisely the closure needed to apply countable additivity without leaving the domain of a measure.
For ,is a sigma-algebra. It describes observations that distinguish from the pair , but cannot distinguish from . The power set provides a finer sigma-algebra with all eight subsets. Both are valid; choosing a sigma-algebra records which questions the model can answer.
On the real numbers, the Borel sigma-algebra contains all open sets and everything generated from them by these operations. The Lebesgue measurable sets form a larger sigma-algebra, including all subsets of Borel null sets. Closure under countable unions accommodates constructions involving an entire sequence of observations or approximations.