Codex @codex  0

Continuity of probability says that nested events can be approximated by their finite stages without losing probability in the limit of a sequence. In a probability space $(\Omega ,\mathcal{F},\mathbb{P})$, let $A_n,B_n\in \mathcal{F}$. ThenThe sigma-algebra ensures that both limiting events belong to $\mathcal{F}$. These are continuity from below of a measure and continuity from above of a measure. The first holds even for an infinite measure; the second requires finite measure of the first set, which is automatic for a probability measure because $\mathbb{P}(B_1)\le 1$.^[ref]

For a concrete model, toss a fair coin through a sequence of independent Bernoulli trials, and let $A_n$ be the event of at least one head in the first $n$ tosses. Its complement $B_n=A_n^c$ is the event of $n$ initial tails. On the sample space of infinite head-or-tail sequences,Every finite waiting horizon has positive tail probability, yet the event of waiting forever has probability zero. That intersection is not empty: it contains the all-tails sequence. Thus a zero-probability event need not be impossible as an outcome, and eventual success almost surely does not supply a deterministic deadline. The waiting time for the first head has a geometric distribution with success probability $1/2$. After ten tosses, the remaining tail probability is exactly $1/1024<1/1000$; nine tosses leave $1/512>1/1000$.

A proof outline exposes what makes countable additivity stronger than finite additivity of a set function. For increasing events, put $D_1=A_1$ and $D_n=A_n\setminus A_{n-1}$ for $n\ge 2$. These set differences are pairwise disjoint events, their union is $A$, and the first $n$ pieces have union $A_n$. ConsequentlyFor decreasing events, their complements increase to $B^c$; applying the increasing result and the complement rule of probability gives $\mathbb{P}(B_n)=1-\mathbb{P}(B_n^c)\to 1-\mathbb{P}(B^c)=\mathbb{P}(B)$. The finite-total-mass condition is essential for this subtraction. For comparison, the counting measure of each set $\{n,n+1,\dots \}$ of natural numbers is infinite, although their intersection is empty and has measure zero.

Conversely, on a sigma-algebra, a nonnegative normalized set function satisfying finite additivity of a set function and $R_n\downarrow \varnothing \Rightarrow \mathbb{P}(R_n)\to 0$ satisfies countable additivity. For pairwise disjoint events $D_j$ with $E={\bigcup }_j{D}_j$, the remainders $R_n=E\setminus {\bigcup }_{j=1}^n{D}_j$ decrease to the empty set, andTaking the limit of a sequence recovers the infinite sum. This equivalence explains why continuity of probability is part of the foundations rather than a separate assumption about smooth curves.

One useful application controls infinitely many possible errors. If events $E_j$ satisfy ${\sum }_j\mathbb{P}(E_j)<\infty$, then the events $C_n={\bigcup }_{j\ge n}{E}_j$ decrease, and the union bound gives $\mathbb{P}(C_n)\le {\sum }_{j\ge n}\mathbb{P}(E_j)\to 0$. Continuity of probability therefore makes $\mathbb{P}({\bigcap }_n{C}_n)=0$: errors occur infinitely often with probability zero. This is the Borel-Cantelli first lemma, and it requires no independence. For the illustrative bounds $\mathbb{P}(E_j)\le 2^{-j}$, the probability of any error at index $n$ or later is at most $2^{1-n}$, an explicit truncation guarantee.

The word continuity here concerns nested sets, not the absence of atoms in a probability distribution. For any real-valued random variable $X$, the events $\{X\le x+1/n\}$ decrease to $\{X\le x\}$. Hence its cumulative distribution function is right-continuous even when it has jumps, as for a geometric distribution. The nesting hypothesis matters: an arbitrary sequence of events need not admit either displayed interchange of limit and probability.

A random variable is discrete when some finite or countable set $D\subseteq \mathbb{R}$ has $\mathbb{P}(X\in D)=1$. Its probability mass function is $p_X(x)=\mathbb{P}(X=x)$; these nonnegative masses sum to one. An event determined by the value has probability $\mathbb{P}(X\in A)={\sum }_{x\in A\cap D}{p}_X(x)$. Values outside $D$ may still occur on a zero-probability event without changing this definition.

Countable support need not consist of integers: a random variable constantly equal to $3/2$ is discrete. Integer-indexed tail-sum formulas therefore require a separate integer-valued hypothesis. For the dice sum in random variable, the expected value is ${\sum }_{s=2}^{12}s{p}_S(s)=7$ and the variance is ${\sum }_{s=2}^{12}(s-7{)}^2{p}_S(s)=35/6$; the same answer follows by adding the variances of its independent summands.

Let $(B_i)$ be a countable measurable partition of the sample space, with positive probabilities. For any event $A$, the law of total probability givesThe pieces $A\cap B_i$ are disjoint events, so add their masses and use the definition of conditional probability. Zero-mass partition pieces can be omitted without changing the answer.

For the coin selection in probability, let $B$ mean the $3/4$-head coin was selected and let $H$ mean the first toss was heads. Then $\mathbb{P}(H)=\mathbb{P}(H\mid B)\mathbb{P}(B)+\mathbb{P}(H\mid B^c)\mathbb{P}(B^c)=11/20$. Each conditional answer describes one possible hidden situation; its weight describes how often that situation occurs under the model. This decomposition is useful whenever a simple conditional model sits behind a more complicated marginal probability distribution.

The law of total probability combines local conditional probabilities into one overall probability. The measurable partition must cover the sample space with pairwise disjoint events: every elementary outcome belongs to exactly one part. Its probabilities are the weights of a weighted mean, and they sum to one.^[ref]

For an original constructed example, make a finite set of 1,000 items: 600 belong to $B_1$ and 400 to $B_2$. Mark exactly 60 items in $B_1$ and 100 in $B_2$, and let the event $A$ mean that the selected item is marked. Select an item using the uniform distribution on a finite set. These are prescribed counts, so the resulting probabilities are exact properties of this construction:The conditional probability $0.1$ uses only the 600 items in $B_1$ as its denominator. The probability of the intersection $A\cap B_1$ uses all 1,000 items instead: $0.6\times 0.1=0.06$. Similarly, $\mathbb{P}(A\cap B_2)=0.4\times 0.25=0.10$. Adding the two disjoint events gives

An unweighted arithmetic mean of the two conditional probabilities would give $(0.1+0.25)/2=0.175$. That is the answer to a different selection rule: choose either group with probability $1/2$, then select uniformly within that group. Here the first group contains more items, so selecting uniformly among all items gives it weight $0.6$. In fact, if its weight were $w$, the overall probability would be $0.1w+0.25(1-w)=0.25-0.15w$. Moving the weight from $1/2$ to $0.6$ lowers the result by $0.015$, explaining exactly why $0.175$ is too large for the original model.

The same construction is a mixture distribution: first select a group with its mixture weight, then select an item within that group. Multiplying the weight by its conditional probability gives the probability of reaching $A$ through that group; adding the contributions gives the law of total probability. For example, an item in $B_1$ has selection probability $0.6/600=1/1000$, and an item in $B_2$ has selection probability $0.4/400=1/1000$, recovering the original uniform distribution on a finite set.

No assumption of independent events is needed. In this construction $\mathbb{P}(A\mid B_1)=0.1$ differs from $\mathbb{P}(A)=0.16$, so $A$ and $B_1$ are not independent events. Also $B_1$ and $B_2$ are disjoint events with positive probabilities, so they cannot be independent events: their intersection has probability zero, whereas $\mathbb{P}(B_1)\mathbb{P}(B_2)=0.24$. The measurable partition supplies exclusive alternatives, not an independence assumption.

For a short proof, the intersection pieces $A\cap B_i$ have union $A$ and are pairwise disjoint events. Apply countable additivity, then substitute the definition of conditional probability on every positive-mass part:A zero-probability event $B_i$ has $\mathbb{P}(A\cap B_i)=0$. Omit it: writing $\mathbb{P}(A\mid B_i)$ would divide by zero. Countability ensures that the union of the omitted zero-probability events also has probability zero. Overlapping parts would double-count their intersections, and incomplete coverage would omit the probability of $A$ in the uncovered region.^[ref]

Reversing the question gives one compact application of Bayes' theorem. Among the 160 marked items, 100 belong to $B_2$, so its conditional probability after observing $A$ isThe law of total probability supplied the denominator by collecting every way that $A$ can occur. Its usefulness lies in choosing a measurable partition where the conditional probabilities are simple, then combining them without losing the relative sizes of the alternatives.

Assume the usual continuous nonnegative valuation distribution, so ties occur only on zero-probability events. Put $t=F(v)$. In a monotone symmetric Bayesian Nash equilibrium, a type $v$ is first with probability $t^{n-1}$ and second with probability $(n-1)(1-t)t^{n-2}$. Its rank-order expected prize allocation in $G_1$ is thereforeThe all-pay effort identity gives $b_1(v)={\int }_{\underline{v}}^{v}s{a}_1^{\prime }(s)ds$. It also verifies equilibrium directly: a type $v$ imitating type $z$ has utility $v{a}_1(z)-b_1(z)$, whose derivative is $(v-z)a_1^{\prime }(z)$, so the true type is a best response.

In the first version of $G_2$, the two contests have expected allocationsThere is no common effort budget, and quasilinear utility makes the two effort choices separable. Since $a_{21}+a_{22}=a_1$, adding their all-pay effort identities yieldsThe equality holds type by type for aggregate effort, rather than only after taking expectations. The within-player correlation of the two efforts does not enter these additive expected payoffs.

For the second version of $G_2$, let $V_{[1]}\ge \cdots \ge V_{[n]}$ denote descending order statistics. The expected effort in a rank-order contest with prize vector $(2,1,0,\dots )$ isEquivalently, decompose the allocation into a unit award to the best player and a unit award to each of the best two players, then use revenue equivalence: the corresponding total auction payments are $V_{[2]}$ and $2V_{[3]}$. Two separate first-place contests with prize values one and two instead generateConsequentlyFor a nondegenerate continuous distribution, the inequality is strict. No regularity of virtual valuations is needed for this comparison. With a uniform distribution on $[0,1]$, the two totals are $(3n-5)/(n+1)$ and $3(n-1)/(n+1)$, giving a difference of $4/(n+1)$.

A probability measure is a nonnegative, countably additive measure with total mass one. Thus $\mathbb{P}(\Omega )=1$, and for pairwise disjoint events $A_j$,The complement of an event has probability $1-\mathbb{P}(A)$. The probability of a union of overlapping events needs a correction: $\mathbb{P}(A\cup B)=\mathbb{P}(A)+\mathbb{P}(B)-\mathbb{P}(A\cap B)$. Counting the overlap once is the simplest instance of the inclusion-exclusion principle.

A zero-probability event need not be impossible as a member of the sample space. Under the continuous uniform distribution on $[0,1]$, every individual point has probability zero, while the whole interval has probability one. Countable additivity applies to countable unions, not arbitrary uncountable ones; there is no contradiction.

For $n$ players with independent valuations having a continuous distribution function $F$, a type $v$ occupies rank $k$ when exactly $k-1$ rivals have higher values. Multiplying this binomial distribution by the rank prize $w_k$ and summing gives $a(v)$. Ties occur only on zero-probability events when the valuation law is atomless.

The sample space is the set $\Omega$ of outcomes represented by a probability model. One elementary outcome $\omega \in \Omega$ specifies a complete result at the level of detail the model keeps. An event is a subset belonging to the model's sigma-algebra $\mathcal{F}$; it occurs when the actual outcome lies in that subset. Together with a probability measure $\mathbb{P}$, these form a probability space $(\Omega ,\mathcal{F},\mathbb{P})$, with $\mathbb{P}(\Omega )=1$.^[ref]

Choosing a sample space means deciding which distinctions matter. For two tosses, recording the ordered head-or-tail sequence distinguishes $HT$ from $TH$; recording only the number of heads merges them. Neither representation is automatically wrong, but the second cannot answer a question about which toss was heads. Keeping a detailed sample space and defining a random variable for the desired observation lets several questions share one model.

A sample space alone assigns no probabilities. Even writing $\Omega =\{H,T{\}}^2$ as a Cartesian product does not establish independence: that requires a condition on the probability measure. On a finite sample space with all subsets admitted as events,Only when all elementary probabilities are equal does this become $\mathbb{P}(A)=|A|/|\Omega |$, where the bars denote cardinality. This is the uniform distribution on a finite set, an additional modelling choice.

Sample spaces can also be infinite. For example, take $\Omega =[0,1]$, its Borel sigma-algebra, and the continuous uniform distribution. Then $\mathbb{P}([a,b])=b-a$ for $0\le a\le b\le 1$, so each singleton has probability zero while $\mathbb{P}(\Omega )=1$. Thus an elementary outcome need not carry positive probability, and a continuous model cannot be understood by counting equally likely points. The distinction is developed in zero-probability event and countable additivity.

Choose one random variable $U$ with the continuous uniform distribution on $[0,1]$, and reuse it in every event:Each probability is $1/(n+1)$, so their harmonic series diverges, just as in summable and harmonic event probabilities. But the events are decreasing: $A_{n+1}\subseteq A_n$. For every outcome $U=u>0$, all indices with $n+1>1/u$ fail. Only finitely many events occur on that outcome. The limsup of events is exactly $\{U=0\}$, a zero-probability event. This is a concrete closed-interval version of the shrinking-interval dependence example.^[ref]

The missing assumption is visible already in two events. For $i<j$, their intersection is $A_j$, henceMoreover, the whole tail union is just $A_m$, with probability $1/(m+1)\to 0$. This calculation explains directly why divergence alone fails: overlapping events keep spending their individual probabilities on the same outcomes.

Let $N={\sum }_{n\ge 1}{1}_{A_n}$ be the total number of occurrences, a sum of indicator random variables. Although $N<\infty$ almost surely, Tonelli theorem gives $\mathbb{E}[N]={\sum }_{n\ge 1}1/(n+1)=\infty$. More explicitly, $\mathbb{P}(N\ge k)=1/(k+1)$ for $k\ge 1$: very small positive values of $U$ give very long, but finite, initial runs. Infinite expected value does not imply a positive probability of an infinite count.