If , then countable additivity gives , even when the limiting measure is infinite.
Continuity of probability 2026-10-14
Continuity of probability says that nested events can be approximated by their finite stages without losing probability in the limit of a sequence. In a probability space , let . Then
The sigma-algebra ensures that both limiting events belong to . These are continuity from below of a measure and continuity from above of a measure. The first holds even for an infinite measure; the second requires finite measure of the first set, which is automatic for a probability measure because .[ref]
For a concrete model, toss a fair coin through a sequence of independent Bernoulli trials, and let be the event of at least one head in the first tosses. Its complement is the event of initial tails. On the sample space of infinite head-or-tail sequences,
Every finite waiting horizon has positive tail probability, yet the event of waiting forever has probability zero. That intersection is not empty: it contains the all-tails sequence. Thus a zero-probability event need not be impossible as an outcome, and eventual success almost surely does not supply a deterministic deadline. The waiting time for the first head has a geometric distribution with success probability . After ten tosses, the remaining tail probability is exactly ; nine tosses leave .
Figure 1.
Exact fair-coin model: success by toss n increases to probability one, while the all-tails prefix probability decreases to zero
. Details.
A proof outline exposes what makes countable additivity stronger than finite additivity of a set function. For increasing events, put and for . These set differences are pairwise disjoint events, their union is , and the first pieces have union . Consequently
For decreasing events, their complements increase to ; applying the increasing result and the complement rule of probability gives . The finite-total-mass condition is essential for this subtraction. For comparison, the counting measure of each set of natural numbers is infinite, although their intersection is empty and has measure zero.
Conversely, on a sigma-algebra, a nonnegative normalized set function satisfying finite additivity of a set function and satisfies countable additivity. For pairwise disjoint events with , the remainders decrease to the empty set, and
Taking the limit of a sequence recovers the infinite sum. This equivalence explains why continuity of probability is part of the foundations rather than a separate assumption about smooth curves.
One useful application controls infinitely many possible errors. If events satisfy , then the events decrease, and the union bound gives . Continuity of probability therefore makes : errors occur infinitely often with probability zero. This is the Borel-Cantelli first lemma, and it requires no independence. For the illustrative bounds , the probability of any error at index or later is at most , an explicit truncation guarantee.
The word continuity here concerns nested sets, not the absence of atoms in a probability distribution. For any real-valued random variable , the events decrease to . Hence its cumulative distribution function is right-continuous even when it has jumps, as for a geometric distribution. The nesting hypothesis matters: an arbitrary sequence of events need not admit either displayed interchange of limit and probability.
Countable additivity Created 2026-09-24 Updated 2026-10-14
For pairwise disjoint measurable sets , countable additivity means
The infinite series is the limit of its nonnegative partial sums. This controls an entire countable union, not merely each finite stage. If enumerate the rational numbers in , their finite collections have Lebesgue measure zero, and countable additivity gives their whole union Lebesgue measure zero. Their being a dense set does not change this calculation.
The axiom makes no assertion about an arbitrary uncountable set of disjoint pieces. In particular, is the union of its singletons, each of Lebesgue measure zero, yet its Lebesgue measure is one. Extending additivity to all such unions would contradict interval length.
If a random variable has a probability density function, each singleton has probability zero because its density has zero integral there. For a countable set , remove duplicates to make the events disjoint. Countable additivity gives . The proof does not extend to uncountable unions merely because each constituent has zero probability.
Countable subadditivity of a measure Created 2026-10-05 Updated 2026-10-06
For measurable sets , a measure satisfies
Replace by the disjoint sets , use countable additivity, and then monotonicity. The same property is an axiom for an outer measure on arbitrary sets.
Counting measure Created 2026-09-29 Updated 2026-10-14
Counting measure makes integration into summation by giving every measurable singleton unit weight. On any measurable space , it is the measure defined by
Thus , a finite set has its usual cardinality, and every infinite set has the same value in the extended real number line. In particular, countably infinite sets and uncountable sets are not distinguished by their counting measure. Taking to be the power set makes every subset measurable; restricting the same rule to a smaller sigma-algebra is also allowed. [ref]
Why is this a countably additive measure? For pairwise disjoint measurable sets ,
If the union is finite, only finitely many are nonempty, and finite cardinality adds. If the union is infinite, either one is infinite or infinitely many are nonempty; in both cases the nonnegative series on the right is infinite. For example, and have counting measures and , and their union has counting measure . The singletons for positive natural numbers give the infinite case: .
With the power set as sigma-algebra, counting measure is a finite measure exactly when is finite, and a sigma-finite measure exactly when is at most countable. For the latter assertion, enumerate by measurable singletons; conversely, every finite-measure set is finite, and a countable union of finite sets is countable. Specifying the sigma-algebra matters: if and , counting measure is not a sigma-finite measure, since the only measurable finite-measure set is the empty set.
For a finite or countably infinite set equipped with its power set, every nonnegative function is a measurable function, and
The supremum allows an infinite result and avoids choosing an order for the terms. On a finite set, expand as a simple function using singleton indicator functions. On a countably infinite set, enumerate the points and apply the monotone convergence theorem to finite truncations. Real or complex functions are integrable functions for counting measure exactly when ; then their integral equals the absolutely convergent sum. This is the discrete counterpart of Lebesgue integration, developed further in series as a Lebesgue integral against counting measure. [ref]
For example, on the positive natural numbers has counting measure integral one, by the geometric series. The alternating harmonic series has a finite ordered sum but is not the integral of an integrable function for counting measure: its positive and negative parts both have infinite sums. Absolute convergence is what makes the finite integral independent of enumeration. In particular, the Lp spaces for counting measure on are the l-p sequence spaces, with their sums replacing continuous integrals.
Compare three measures on the same Borel sigma-algebra of the real numbers: counting measure , Dirac measure , and Lebesgue measure .
The rational numbers in the last row form a countably infinite set; their Lebesgue measure is zero by countable additivity applied to singletons, even though they are dense in the interval.
Figure 1.
The same Borel sets have different sizes under counting measure, Dirac measure, and Lebesgue measure
. Original analytical comparison on the real numbers, with the selected point marked in orange. Drawings show the finite sets and the interval; the rational numbers are named symbolically because finitely many plotted points cannot depict that infinite dense set. Green zero entries mark the null sets for each column's measure. Details.
These are different answers to different questions: counting measure asks how many points occur, Dirac measure asks whether the selected point occurs, and Lebesgue measure asks how much length occurs. A null set therefore depends on its measure. For counting measure, the only null set is the empty set, so equality almost everywhere is equality everywhere. For , a measurable set is a null set exactly when it misses ; for Lebesgue measure, even the infinite set is a null set. Integrating an indicator function recovers each table entry through . This lets the same Lebesgue integral framework handle point counts, point evaluation, and geometric length.
A normalized positive linear functional on for Cantor space gives a finitely additive set function on the algebra of clopen sets. If a countable disjoint union of such sets is itself clopen, compactness gives a finite subcover; all other terms are empty. Finite additivity therefore gives the required countable additivity, making a premeasure. The Caratheodory extension theorem produces a unique Borel probability measure.
Dirac measure Created 2026-10-05 Updated 2026-10-14
On a measurable space , the Dirac measure at assigns unit mass according to whether a measurable set contains that point:
Here is the indicator function. This is a probability measure, since . For pairwise disjoint measurable sets , at most one contains , so : countable additivity reduces to a membership test. The definition works even when the singleton is not a measurable set. [ref]
To assert that its support of a measure is exactly , assume that is a metric space and is its Borel sigma-algebra. The singleton is then a closed set and a Borel set, with . Every open neighbourhood of has mass one; every other point has an open ball of radius less than its distance from , with mass zero. Thus . An abstract measurable space has no specified topology, so this topological conclusion is not part of the bare definition. Indeed, on the sigma-algebra , all Dirac measures coincide: the available measurable sets cannot distinguish points.
The Lebesgue integral against a Dirac measure is evaluation:
This holds for every nonnegative measurable function, allowing an infinite value, and for real or complex measurable functions satisfying , which are precisely the integrable functions for . For a nonnegative simple function, only the cell containing contributes to its integral; increasing simple functions and the monotone convergence theorem extend the identity. Splitting into positive and negative parts, and then real and imaginary parts, gives the remaining cases. This is why a Dirac measure turns integration into a point query.
For a measurable function , its pushforward measure satisfies
Consequently for nonnegative or integrable measurable functions . For example, on the real numbers with their Borel sigma-algebra, sends to , so integrating against that pushforward measure gives . [ref]
Finite weighted sums of Dirac measures give useful measures with finitely many point masses. For finite nonnegative weights ,
for nonnegative measurable functions , or whenever , with zero-weight terms omitted. Repeated locations have their weights added. On the real numbers, this is the finite version of the measure underlying the left-continuous cumulative function of an atomic measure; a positive-weight singleton is an atom of a measure. Unit weights at the distinct points of a finite set recover counting measure on that set. [ref]
The same function can have sharply different integrals for different measures. On with its Borel sigma-algebra, define
Here is Lebesgue measure and is counting measure. The singleton is a Lebesgue null set, so its changed value leaves the Lebesgue integral equal to . For counting measure on the whole interval, on an infinite set, forcing an infinite integral. On the smaller measure space with its power set and counting measure, the restricted function instead has integral .
Figure 1.
An isolated value contributes differently to Dirac measure, counting measure, and Lebesgue measure
. Original analytical illustration of the specified function, with an open circle at the excluded value and a filled point at the actual value . The finite sum uses ; the other three integrals use the same ambient interval . The drawn area is the Lebesgue integral, and no density curve is assigned to the Dirac measure. Details.
This also explains the almost everywhere convention in Lp spaces: equality almost everywhere for requires equality at , whereas equality almost everywhere for Lebesgue measure allows different values at that singleton. A point value therefore cannot be read unambiguously from an equivalence class in an Lp space formed using Lebesgue measure.
On the real numbers, a Dirac measure gives the Dirac delta distribution by for every test function. The name Dirac delta function does not mean an ordinary function that is zero away from and infinitely high at . Such a nonnegative measurable function still has Lebesgue integral zero, because its nonzero values occur on a Lebesgue null set. More generally, no nonnegative density with respect to Lebesgue measure can represent : it would give , contradicting unit mass. The measure and its associated distribution act on different kinds of inputs, namely measurable sets and test functions, but express the same point evaluation. [ref]
For finite positive measures on the same sigma-algebra, their least common upper bound in the order on measures is
Empty cells are allowed. This is a measure, not merely a set function: for a disjoint countable union, intersect any candidate partition with its components for the upper bound, and combine partitions whose errors sum to less than a prescribed for the lower bound. Countable additivity of each component gives both inequalities. Any measure dominating every dominates each partition sum and hence this supremum. The result is bounded above by and so remains finite.
If all components have densities with respect to a common measure , then the supremum has density . For the upper bound integrate the pointwise maximum. For equality, partition by the smallest index attaining that maximum; these are measurable sets. For example two measures supported on disjoint sets have their sum as supremum, rather than the numerical maximum of their masses on the whole space.
Kolmogorov axioms Created 2026-09-29 Updated 2026-10-31
The Kolmogorov axioms describe a consistent way to assign probabilities to events. Start with a sample space and an event sigma-algebra : it contains and is closed under complements and countable unions, hence also countable intersections. The probability measure is a function satisfying
The triple is a probability space. The third axiom is countable additivity; the infinite series means the limit of a sequence of nonnegative partial sums. It applies to pairwise disjoint events, not to overlapping events and not to arbitrary uncountable unions.[ref]
The sigma-algebra specifies which questions have probabilities, while the axioms specify how those probabilities fit together. For a finite sample space one can take the entire power set; a continuous model commonly uses a Borel sigma-algebra. Nonnegativity and normalization do not require equally likely outcomes or independence: those are additional modelling choices.
For an exact six-outcome model, take , , and assign . The total is one because . Define the probability of an event by summing the weights of its outcomes. The disjoint events , and form a partition of a set with
This is a specified mathematical model, not measured die frequencies. The figure makes probability literal area: each region has the same height and a width proportional to its assigned mass. Regrouping disjoint events preserves their total area.
Figure 1.
Exact six-outcome model with masses k/21: grouping disjoint outcomes adds their probability areas
. Details.
Several familiar rules are consequences, not further axioms. Finite additivity of a set function follows by appending empty events to the sequence in countable additivity; follows already by writing as a disjoint union. The complement rule of probability gives and therefore . Splitting larger events into a smaller event and a set difference shows .
For overlapping events, the inclusion-exclusion principle corrects double counting:
In the six-outcome model, and give , agreeing with the weight of . This decomposition is useful because a complicated event can be assembled from simpler questions with known probabilities.
On a finite sample space, a family of pairwise disjoint events has only finitely many nonempty members, so finite additivity of a set function already handles every countable disjoint union. On an infinite sample space, the countable axiom additionally controls what is left beyond every finite stage. In the fair-coin waiting model of continuity of probability, the finite-stage calculations sum to through toss . Countable additivity makes the probability of a head at some finite toss equal to ; finite-stage sums alone do not justify that passage. For the continuous uniform distribution on , each singleton instead has probability zero, while their uncountable union has probability one. Countable, rather than unrestricted, additivity accommodates both models.
Historically, Kolmogorov's 1933 book Grundbegriffe der Wahrscheinlichkeitsrechnung established the influential axiomatic framework connecting probability theory with measure theory. The three conditions above are the modern presentation on a sigma-algebra. Shafer and Vovk's historical study explains that the original presentation began with finite additivity on an algebra of sets and added continuity for decreasing events with empty intersection, which supplies the countable extension.[ref]
Law of total probability Created 2026-09-24 Updated 2026-10-18
Let be a countable measurable partition of the sample space, with positive probabilities. For any event , the law of total probability gives
The pieces are disjoint events, so add their masses and use the definition of conditional probability. Zero-mass partition pieces can be omitted without changing the answer.
For the coin selection in probability, let mean the -head coin was selected and let mean the first toss was heads. Then . Each conditional answer describes one possible hidden situation; its weight describes how often that situation occurs under the model. This decomposition is useful whenever a simple conditional model sits behind a more complicated marginal probability distribution.
The law of total probability combines local conditional probabilities into one overall probability. The measurable partition must cover the sample space with pairwise disjoint events: every elementary outcome belongs to exactly one part. Its probabilities are the weights of a weighted mean, and they sum to one.[ref]
For an original constructed example, make a finite set of 1,000 items: 600 belong to and 400 to . Mark exactly 60 items in and 100 in , and let the event mean that the selected item is marked. Select an item using the uniform distribution on a finite set. These are prescribed counts, so the resulting probabilities are exact properties of this construction:
The conditional probability uses only the 600 items in as its denominator. The probability of the intersection uses all 1,000 items instead: . Similarly, . Adding the two disjoint events gives
Figure 1.
A partition turns within-group rates into whole-population areas
. An original constructed finite set with 1,000 items, represented by area rather than measured data. The two widths encode probabilities and ; the shaded heights encode conditional probabilities and . The shaded intersection areas encode 60 and 100 marked items, totaling 160. Details.
An unweighted arithmetic mean of the two conditional probabilities would give . That is the answer to a different selection rule: choose either group with probability , then select uniformly within that group. Here the first group contains more items, so selecting uniformly among all items gives it weight . In fact, if its weight were , the overall probability would be . Moving the weight from to lowers the result by , explaining exactly why is too large for the original model.
The same construction is a mixture distribution: first select a group with its mixture weight, then select an item within that group. Multiplying the weight by its conditional probability gives the probability of reaching through that group; adding the contributions gives the law of total probability. For example, an item in has selection probability , and an item in has selection probability , recovering the original uniform distribution on a finite set.
Figure 2.
Multiply along each route and add the routes ending in the event
. The original constructed model expressed through group selection and a marked-or-unmarked result. First-stage weights are probabilities; second-stage weights are conditional probabilities. The four final probabilities sum to one. The two routes to the event contribute . Details.
No assumption of independent events is needed. In this construction differs from , so and are not independent events. Also and are disjoint events with positive probabilities, so they cannot be independent events: their intersection has probability zero, whereas . The measurable partition supplies exclusive alternatives, not an independence assumption.
For a short proof, the intersection pieces have union and are pairwise disjoint events. Apply countable additivity, then substitute the definition of conditional probability on every positive-mass part:
A zero-probability event has . Omit it: writing would divide by zero. Countability ensures that the union of the omitted zero-probability events also has probability zero. Overlapping parts would double-count their intersections, and incomplete coverage would omit the probability of in the uncovered region.[ref]
Reversing the question gives one compact application of Bayes' theorem. Among the 160 marked items, 100 belong to , so its conditional probability after observing is
The law of total probability supplied the denominator by collecting every way that can occur. Its usefulness lies in choosing a measurable partition where the conditional probabilities are simple, then combining them without losing the relative sizes of the alternatives.
Lebesgue measure Created 2026-09-24 Updated 2026-10-14
Lebesgue measure on the real numbers extends interval length: for . Its restriction to the Borel sigma-algebra is the unique translation-invariant sigma-finite measure on that sigma-algebra normalized by . The full Lebesgue measure is the completion of a measure of this restriction; its domain is the Lebesgue measurable sets. Translation invariance follows by comparing a translated Borel measure on half-open intervals and applying the uniqueness theorem for measures. For the construction and interval properties, see MIT lecture 8.
Every singleton has Lebesgue measure zero: gives for every . Enumerating the countable set and applying countable additivity yields
Thus a dense set can be a null set, and a union of null sets indexed by an uncountable set can have positive Lebesgue measure. The distinction explains both the Dirichlet function example and why almost everywhere is weaker than everywhere.
For a regular outer measure and measurable , the forward implication is countable additivity. For the reverse, choose a measurable hull of and intersect it with to obtain and . Measurability of splits into and , so
The assumed equality and finiteness force . Every outer-measure-null set is measurable by Caratheodory measurability criterion, so is measurable. Finiteness prevents invalid subtraction of infinite masses.
Measure Created 2026-09-24 Updated 2026-10-14
On a measurable space , a measure is a function with and countable additivity: for pairwise disjoint measurable sets ,
Infinite size is permitted. Nonnegativity implies that if measurable sets satisfy , then : decompose into and . For overlapping measurable sets, use countable subadditivity rather than adding their full sizes twice.
For example, counting measure gives , while a Dirac measure gives that same set size if it contains . Under Lebesgue measure, has size . These are all measures, but they answer different questions: how many objects, whether a distinguished object is present, or how much length is occupied.
Monotonicity of a measure 2026-10-31
For measurable sets , the disjoint union and finite additivity give . This uses nonnegativity and is valid with infinite values; it does not subtract infinities. Monotonicity of a measure implies that increasing measurable sets have nondecreasing measures, but the equality of their limit with the measure of their union uses the stronger axiom of countable additivity.
p-adic measure 2026-10-14
For a profinite group and a complete discrete valuation ring with a continuous -algebra structure, an -valued measure is a bounded -linear functional on continuous -valued functions, with the uniform norm. Equivalently it assigns finitely additive values in to clopen sets. Locally constant functions are uniformly dense, so integration extends uniquely from finite sums. Countable additivity in the usual real-measure sense is not imposed. The coefficient ring may have infinite residue field and need not be compact.
A measurable space is a pair where is a sigma-algebra of subsets of : it contains , is closed under complements relative to , and is closed under countable unions. A measure on it is a function with and countable additivity:
whenever the measurable sets are pairwise disjoint. Infinite values are allowed. The triple is a measure space.
Because , the family contains . If , then belongs to and is a subset of , so it belongs to . If each , their countable union belongs to and remains a subset of . Thus is a sigma-algebra on , with relative complements taken in , not in .
Equivalently,
the trace sigma-algebra on the measurable set . The measurability of is what makes this equal to the family in the question.
The function takes values in and has . For any pairwise disjoint , countable additivity of gives
Therefore is a measure on : it is the restriction of a measure to a measurable subset.
For the increasing family, define the measurable sets
They are pairwise disjoint, with and . By countable additivity,
The nonnegative series is defined by its increasing partial-sum limit, so this proof also covers an infinite value. This is continuity from below of a measure.
For the decreasing family, put . These measurable sets increase, and
Since , finite additivity gives legitimate finite subtractions:
Apply the first result to and subtract from to obtain
This is continuity from above of a measure. Its finiteness hypothesis matters: for Lebesgue measure and , every has infinite measure but their intersection is empty. The proof must not subtract .
A measurable space is a set together with a sigma-algebra of its subsets: it contains and is closed under complements relative to and countable unions. A measure is a map with and countable additivity on disjoint measurable sets:
A finite measure additionally satisfies .
A measure space consists of a set , a sigma-algebra of subsets, and a countably additive map with . A sigma-algebra contains and is closed under complements and countable unions. Countable additivity means for pairwise disjoint measurable sets. Such sets are called measurable; a real function is measurable when the inverse image of every Borel set belongs to .