Because each increment is , the event at time defining is exactly . Therefore, for ,
and for this event is empty. Thus is a stopping time for the natural filtration.
On the other hand, . This event has probability , whereas the initial sigma-algebra is trivial, even after completion up to null sets. It therefore cannot belong to . Hence is not a stopping time. Subtracting a deterministic delay from a stopping time can require information from the future.
Define , where is the Dirac measure at . For the full sigma-algebra of subsets of a finite , affineness directly gives .
The statement also holds for an arbitrary sigma-algebra on a finite set. List each atom of a sigma-algebra as and choose . Points in one atom have identical Dirac measures on this sigma-algebra, so is constant on each atom and is measurable. Every probability measure decomposes as , whence
This is the expected utility representation on a finite measurable space. It does not silently assume that each singleton is measurable.
Write a finite binary word as and denote its prefix cylinder set by
More generally, a cylinder set fixes finitely many coordinates, or prescribes a subset of their finite coordinate product, leaving all other coordinates free. Each coordinate factor is discrete, so finite-coordinate inverse images are both open and closed. Thus cylinders are clopen. The basic open sets of the product topology restrict only finitely many coordinates, so cylinders form a base. Any finite-coordinate cylinder is a finite union of prefix cylinders of one sufficiently long common length; the prefix cylinders therefore also form a base.
The Bernoulli space here is Cantor space, with compatible metric
It is a compact metric space: from any sequence, choose successively subsequences constant in the first, second and subsequent coordinates, and take the diagonal subsequence. Agreement on the first coordinates bounds the distance by , proving convergence. Compactness also follows from Tychonoff theorem.
Every cylinder indicator function is continuous because the cylinder is clopen. Hence is a vector subspace of the space of continuous functions on a compact space. To prove density, fix and . By uniform continuity, choose so that implies . Choose a point in each length- prefix cylinder and put
Then and . This proves cylinder-function density in Cantor space:
Positivity of implies monotonicity. The pointwise bounds therefore give
Evaluation on attains equality, so is continuous and has norm one. This is the norm of a positive functional on C(K).
The object extended to open sets is the set function , rather than the functional itself. Positivity gives , and linearity gives finite additivity on disjoint cylinders. To construct its extension directly, use the disjoint cylinder decomposition of open subsets of Cantor space. For an open , take the shortest prefixes for which . They are prefix-free, their cylinders are disjoint, and their union is . Define
For , use the empty prefix; for , use the empty sum.
This value is independent of the chosen disjoint prefix-cylinder decomposition. Indeed, compare two such decompositions and . For each fixed , its intersections with the give a disjoint open cover of the compact cylinder . Compactness reduces this to finitely many nonempty intersections. Each intersection is a prefix cylinder or is empty, so finite additivity gives . Sum over and rearrange the nonnegative double sum. Doing the same with each proves equality of the two totals.
For disjoint open sets , combine their disjoint cylinder decompositions to obtain one for . Rearrangement of nonnegative sums proves countable additivity on this family of open sets. The extension is unique because any countably additive extension must have the prescribed sum on every disjoint cylinder decomposition. Open sets are not themselves a sigma-algebra; countable additivity here concerns disjoint open families and their open union.
For the Borel probability measure, let be the algebra of finite unions of prefix cylinders. It is also the algebra of clopen sets, because every clopen set is compact and has a finite cylinder cover. Define on . If with all sets in , compactness of gives a finite subcover by the . Disjointness makes all remaining members empty. Thus finite additivity already establishes the premeasure condition.
The Caratheodory extension theorem gives a unique measure on . This is the Borel sigma-algebra, since the cylinders are a countable base; . Its values on open sets agree with the extension above. For cylinder simple functions,
Both sides are continuous in the supremum norm, so cylinder-function density in Cantor space gives
Any other Borel probability measure with this property agrees on every cylinder indicator function, hence on , and uniqueness in the Caratheodory extension theorem makes it equal to . This proves the Cantor-space representation of positive functionals without assuming the general representation theorem.
Now let be the supplied continuous surjection. The pullback
is a unital isometric embedding: surjectivity gives . On the vector subspace , define . This is well-defined, has norm one and satisfies .
The real Hahn-Banach theorem extends to on all of with the same norm. Norm preservation alone does not automatically mean positivity, so verify it. If , then and
Scaling proves positivity for every nonnegative . This is the unital contraction positivity criterion, giving a positive extension from a unital subspace of C(K).
Represent by the already constructed Borel probability measure on and take the pushforward measure . Continuity of makes its Borel inverse images measurable, and . The pushforward integral identity gives
This is compact-metric representation by Cantor-space pullback. The hypothesis already excludes an empty . The measure is on the Borel sets; no uniqueness claim on an unspecified larger collection of subsets is needed.
Construct the densities using the Riesz representation theorem for a Hilbert space, rather than assuming the measure-decomposition conclusion. Put , a finite dominating measure, and work in the real L2 space . The linear functional
is well-defined on its equivalence classes because . By the Cauchy-Schwarz inequality,
Thus the Riesz representation theorem supplies such that . Since is finite, is also integrable. Testing gives
The first identity and nonnegativity of rule out a positive-measure set where ; for example, test . The second identity and nonnegativity of similarly rule out . Modify a measurable representative on a -null set so that everywhere. This is the Hilbert-space construction of dominated measure densities.
Set
Then and . The indicator identities for extend to integrals of nonnegative measurable functions by approximation with simple functions and the monotone convergence theorem. Consequently,
and, for every ,
Hence
This proves Lebesgue decomposition from a sum-measure density. The argument includes the cases of zero measures; there is no division on , where the denominator vanishes.
Absolute continuity of measures, written , means that implies for every . If , then in the construction above, so the singular term vanishes. Conversely, if with a nonnegative integrable , that integral is zero on every -null set. Thus
This is the finite-measure Radon-Nikodym theorem as a consequence of the proved construction.
Finally restrict the base measure to the sub-sigma-algebra . For a real , write , with both parts nonnegative and integrable. On define finite positive measures
They are absolutely continuous with respect to . The result just proved gives nonnegative, -measurable densities satisfying
Set . Since , this is in , and subtraction gives
For complex , apply the real construction separately to its real and imaginary parts and combine the two results. This is conditional expectation from finite-measure densities. The resulting conditional expectation is unique almost everywhere: for two real versions, their difference has integral zero on its positive and negative level sets in , forcing it to vanish; apply this to both components in the complex case. No probability normalization of is required.
  • for every .
  • .
  • For pairwise disjoint events, .
For arbitrary events, Boole's inequality is . To prove it, replace each by . The are disjoint, have the same union, and satisfy . Countable additivity and monotonicity give . Finite unions are included by taking subsequent events empty.
Let be the th heads event. For every , the event of infinitely many heads lies inside . By the union bound, its probability is at most , which tends to zero. Thus the probability of infinitely many heads is . This is the First Borel-Cantelli lemma, and requires no independence of the coin tosses.
For the dice experiment there are ordered outcomes giving a sum of and giving , out of . Each trial therefore has , and irrelevant-outcome probability . By independence between trials, summing over the number of initial irrelevant outcomes gives
The geometric series also shows that one of the two relevant sums eventually appears almost surely. Equivalently, first-step analysis gives .
An independence graph of events, also called a dependency graph of events, has one vertex for each event , with independent of the entire family of events indexed by its nonneighbors. Precisely, is independent of the sigma-algebra generated by those events. Pairwise independence alone is insufficient.
The asymmetric Lovász local lemma says that if numbers satisfy
then for a finite family. In the commonly used symmetric Lovász local lemma, if each probability is at most and the maximum graph degree is at most , the sufficient condition is
The conditional expectation is a -measurable integrable random variable such that
It is defined up to almost sure equality. Measurability with respect to the sub-sigma-algebra and equality of these integrals are both essential: the first expresses that only the information in is retained, and the second preserves all averages visible through that information. Existence follows from the Radon-Nikodym theorem; uniqueness is up to sets of probability zero.
On a fixed underlying set, a pi-system is a nonempty family closed under finite intersections. A Dynkin system, also called a d-system, contains the whole underlying set, is closed under complements relative to it, and under countable disjoint unions. Equivalently it is closed under differences of nested members and increasing countable unions. A sigma-algebra contains the whole set, is closed under complements and arbitrary countable unions, hence also countable intersections. A Dynkin system need not be a sigma-algebra unless additional intersection closure is available.