Work with a probability measure-preserving system, so . Put
The maximal ergodic theorem, also called the maximal ergodic lemma, says that for real ,
No ergodic transformation or invertibility assumption is needed for this maximal ergodic lemma.
Here is a proof of the maximal ergodic lemma. Set and . These are integrable: . Splitting off the first summand gives
On , this implies . Outside the right side is . Consequently
Integrating and using the measure-preserving transformation property gives . Since increases to , the dominated convergence theorem, with dominating function , proves the infinite-supremum assertion of the maximal ergodic lemma.
For example, applying the maximal ergodic lemma to yields the useful maximal bound
Indeed on the latter set , the maximal ergodic lemma gives .
The pointwise ergodic theorem states that for a probability measure-preserving system and ,
where is the invariant sigma-algebra. The conditional expectation is invariant and has integral . If is an ergodic transformation, this conditional expectation is the constant . The assertion applies to real or complex integrable functions; it is the Birkhoff ergodic theorem.
For a nonnegative measurable , if , the pointwise ergodic theorem already proves the required conclusion. For the remaining case, let , . Each is integrable on the probability measure-preserving system. The pointwise ergodic theorem and ergodic transformation property give, on a single set of full measure obtained by a countable intersection,
Since , every such satisfies for all . The monotone convergence theorem gives . Thus the nonnegative ergodic averages with infinite integral tend to , rather than merely having an unbounded subsequence. Combining the two cases,
Nonnegativity is what makes truncation a lower bound. The probability normalization is also essential to the displayed value: for a finite measure of total mass , the corresponding constant is .
The Szemerédi theorem says that for every integer and every , there is such that, for , every with contains a nonconstant arithmetic progression
Equivalently, every subset of the positive integers with positive upper asymptotic density contains arithmetic progressions of every finite length. Length one is immediate.
The Furstenberg multiple recurrence theorem states that for every probability measure-preserving system, every measurable with , and every integer , there is with
Here means a preimage, so invertibility is unnecessary. The Furstenberg multiple recurrence theorem also does not assume an ergodic transformation.
We prove the implication to the finite Szemerédi theorem by constructing the Furstenberg correspondence principle explicitly. Suppose, to the contrary, that for fixed and there are and with , but with no length- arithmetic progression of positive common difference. In the binary full shift , encode as , taking all coordinates outside to be zero. Let be the left shift, , and set
The cylinder set is a clopen set, and . The binary full shift is a compact metric space, so compactness of probability measures on a compact metric space gives a subsequence of these empirical measures with weak convergence of probability measures to a Borel probability measure .
For every continuous on the full shift,
Passing to the weak limit shows that is an invariant measure for the continuous left shift. Thus is a probability measure-preserving system. Since the indicator function of is continuous, .
Apply the Furstenberg multiple recurrence theorem to . For some , the clopen set
has . Its continuous indicator function gives . For large , at least one in the defining empirical measure therefore belongs to . The choice of left shift implies
so lies in . This contradicts the assumed absence of arithmetic progressions and proves the finite Szemerédi theorem. Applying the finite Szemerédi theorem on intervals where an infinite set has density bounded below proves the stated upper asymptotic density formulation.
For multiple recurrence for circle rotations, write and , with normalized Lebesgue measure , which is the Haar measure of the circle group. Fix a measurable with and . If is rational, there is with the identity, and gives an intersection of measure .
For irrational , the pigeonhole principle applied to in equal arcs gives with . In particular there are arbitrarily small nonzero returns to zero for the irrational rotation of the circle.
We also need translation continuity in L1 on the circle. Given a measurable , approximate its indicator function in the L1 norm by a continuous on the circle group. Such approximation follows from regularity of Lebesgue measure, or approximation by finite unions of intervals. Translation invariance and uniform continuity give
where the approximation error is first made arbitrarily small. Equivalently, .
Choose a return time so small modulo one that for each ,
This is possible because multiplication by each fixed is continuous on the circle group and translation continuity in L1 on the circle applies to the finitely many translates. The union bound now gives
This proves the Furstenberg multiple recurrence theorem for every circle rotation with its normalized Lebesgue measure, including both rational and irrational angles.
For a probability measure-preserving system, strong mixing means that for every pair of measurable sets ,
A sequence has convergence in density of a sequence to when for each the exceptional set has natural density zero. A weakly mixing measure-preserving transformation has convergence in density of to for every . Equivalently, because these correlations are bounded,
Indeed the mean of the absolute discrepancy is at least times the exceptional frequency, while it is at most plus a uniform bound times that frequency. A signed Cesaro convergence of a sequence without absolute values is insufficient to define weak mixing.
The standard three-cut Chacon map is obtained by cutting and stacking. Start on with normalized Lebesgue measure, an initial tower consisting of , and a reservoir for spacers. At stage , cut every level of the current tower into three equal subintervals, producing three subcolumns. Add one new interval of the same width above the middle subcolumn. Stack the first subcolumn at the bottom, then the middle subcolumn with its spacer, then the third at the top. Define the partial transformation by translation from each level to the next, leaving the current top unmapped. These assignments extend the earlier partial transformation. Repeat indefinitely.
If is the number of levels and their width, then
Hence , , and the stage- tower has measure . The spacers consume total measure , precisely the reservoir. The increasing partial maps give the Chacon map modulo null sets. The tower tops and unused reservoir have measures tending to zero, and the construction yields an invertible measure-preserving transformation. With marking an original level and a spacer, the tower words satisfy and , so the first new word is . This describes the spacer placement without needing a proof of well-definedness. The three-cut convention agrees with the classical constant spacer vector described in Ryzhikov's construction.
For the correlation assertion, take the L2 inner product to be , linear in its first argument, and put . The Koopman operator is an isometry on , even when is not invertible. For the hint gives
To extend rigorously to all test functions, centre the observable: . Invariance of the integral gives . Let
For each fixed , by the same isometry identity. Therefore the limit is zero for every finite linear combination of these orbit vectors. By the Cauchy-Schwarz inequality and , approximation extends this conclusion to every : the approximation error in the correlation is bounded by uniformly in . For , the correlation is identically zero because . The orthogonal decomposition by a closed subspace now gives the result for all . Thus
This is decay of autocorrelation implies weak convergence of an observable; no assumption that is an ergodic transformation, and no invertibility hypothesis was used, and is included.
Finally, strong mixing immediately implies the stated diagonal limit by taking . Conversely, suppose that limit holds for every . Apply the correlation result with and . Its hypothesis is exactly , and its conclusion is
Hence strong mixing is equivalent to diagonal set-correlation criterion for mixing. Using the orbit-span proof avoids an invalid polarization argument that would recover only the sum of the two directed cross-correlations from diagonal correlations.
On a probability measure-preserving system, for a finite measurable partition , the entropy of a finite measurable partition is
Use natural logarithms, so information entropy is measured in nats; another fixed logarithm base rescales all answers. The join of measurable partitions is their common refinement, and write , with an empty join the trivial partition. The entropy rate of a measurable partition and Kolmogorov-Sinai entropy are respectively
The block entropies form a subadditive sequence, so the first limit exists by the Fekete lemma. For finite partitions the conditional entropy of finite measurable partitions is .
Put and for . The chain rule for information entropy, applied from the last coordinate backwards, and measure preservation give
The second equality uses invariance of the joint partition atom probabilities under the common pullback ; invertibility is unnecessary. Since conditioning reduces entropy, decreases to a nonnegative limit . The Cesaro convergence of a sequence of this convergent sequence has the same limit. Therefore
Equivalently , where . Here conditional entropy of a countable measurable partition conditioned on a sigma-algebra is computed using conditional partition atom probabilities; the martingale convergence theorem gives continuity under increasing conditioning sigma-algebras. This is the infinite-future formula for partition entropy rate.
The Kolmogorov-Sinai generator theorem states that if a finite or countable measurable partition has finite entropy of a countable measurable partition and its iterates generate the whole completed sigma-algebra modulo null sets, then . For an invertible system, generating means modulo null sets. For a noninvertible system a one-sided generator, using , suffices. The two-sided and one-sided versions must not be confused.
For a Bernoulli shift with discrete symbol probabilities , the coordinate-zero measurable partition has independent coordinate iterates. Thus
For a finite alphabet the coordinate partition is a generator of finite entropy of a finite measurable partition; on the two-sided sequence space use all integer coordinate iterates, and on the one-sided space use the nonnegative ones. The Kolmogorov-Sinai generator theorem proves the displayed answer in both cases. The same calculation applies to countably many symbols when their Shannon entropy is finite, using the countable finite-entropy version of the theorem. If the Shannon entropy is infinite, merge all but the first symbols into one cell. These finite coordinate partitions have entropy rate , so the system entropy is infinite. Zero-probability symbols contribute zero. In particular a fair -symbol shift has entropy .
For the final assertion, let and complete it modulo null sets. The approximation property forces modulo null sets. Indeed for each , choose approximating sets from finite blocks with error tending to zero. Their indicators approach in , and is a closed vector subspace, so is -measurable modulo a null set.
Invertibility now gives modulo null sets. In particular the present partition is measurable with respect to its entire future, so . The infinite-future formula gives . Since the given one-sided generator is also a two-sided generator, the Kolmogorov-Sinai generator theorem finishes the proof:
This is finite one-sided generator of an invertible system forces zero entropy. Invertibility is essential: a fair binary one-sided Bernoulli shift has a finite one-sided generator and Kolmogorov-Sinai entropy .
For a probability measure-preserving system, the hypothesis is completely positive entropy: every finite measurable partition with positive static entropy of a finite measurable partition has positive entropy rate of a measurable partition. Fix a finite partition and put
All sigma-algebras are interpreted modulo null sets. We will prove that every finite partition measurable with respect to this tail sigma-algebra of a measurable partition has . Applying this to a binary partition will force the required triviality. This proves the needed direction of the Tail characterization of the Pinsker sigma-algebra directly, including noninvertible transformations.
Write . The infinite-future entropy formula and the backwards chain rule for information entropy give, for every , the block conditional entropy given the infinite future identity
Each term equals by invariance of the joint probabilities under a common pullback and continuity of conditional entropy under increasing finite future blocks. Invertibility is not needed for this identity.
Fix . Since is -measurable and finite, the martingale convergence theorem and continuity of finite-partition conditional entropy allow an with
To see the continuity explicitly, for each partition atom of the conditional probabilities tend to almost everywhere; apply dominated convergence theorem to the bounded continuous function on and sum over the finitely many partition atoms.
For set , , and . The conditional entropy of finite measurable partitions satisfies
The second inequality uses conditioning reduces entropy, since refines each block ; the final equality uses measure preservation.
Moreover is -measurable. For each , tail measurability gives measurable with respect to , hence measurable with respect to . Thus conditioning reduces entropy and the displayed block identity imply
Use the symmetric entropy identity to obtain
The fraction on the right tends to zero: is fixed and by the definition of entropy rate of a measurable partition. Taking and then gives
Now let and take . If , its binary entropy is , while its entropy rate is zero, contradicting completely positive entropy. Therefore
Since was arbitrary, every finite-partition tail is trivial. The argument needs only that is finite and the measure is a probability; it does not assume a finite generator, finite total system entropy, or invertibility.
Use the probability-system convention . The Birkhoff ergodic theorem, also called the pointwise ergodic theorem, states that for a measure-preserving system and ,
where is the invariant sigma-algebra. The limit is integrable and has the same integral as . On a probability space the convergence also holds in , as in the allowed mean ergodic theorem. If is an ergodic transformation, is trivial modulo null sets, giving
The integer multiplication map on the circle preserves Lebesgue measure: for any integrable on ,
To prove the ergodicity of integer multiplication on the circle, suppose satisfies . Let be its Fourier coefficients in the Fourier basis . Since , the Fourier coefficients of at index are zero if does not divide , and are otherwise. This identity holds for all functions by approximation with trigonometric polynomials and the isometry . Invariance gives
Every nonzero integer can be divided by only finitely often. Thus for every , and completeness of the Fourier basis makes constant almost everywhere. Applying this to the indicator function of an invariant set gives measure zero or one, so
A normal number in base has every word of base- digits occurring with limiting overlapping frequency . Use the expansion that is not eventually equal to when there are two expansions. The word corresponds to the half-open interval
A word starting at position occurs exactly when . The Birkhoff ergodic theorem, applied to , gives frequency almost everywhere. There are countably many pairs , so their full-measure sets have a full-measure intersection. In particular,
These are absolutely normal numbers, so existence follows as well. This interval description also proves normality and equidistribution under integer multiplication: the base- intervals form arbitrarily fine grids, so their frequencies imply the correct frequency for every interval by approximation from inside and outside.
For the growth assertion, put . For every , the Tonelli theorem gives the useful summability bound
Since is a measure-preserving transformation, . The first Borel-Cantelli lemma shows that occurs only finitely often almost everywhere. Intersecting the resulting full-measure sets for proves the linear growth bound for integrable observables, . Multiplication by then gives
The threshold is sharp. For , choose with , and take the Bernoulli shift on with the product measure of independent uniform coordinates. The left shift preserves that measure because it preserves the probability of every finite-coordinate event. Define ; it is integrable because
The variables are independent. For any fixed ,
The probability sum diverges, so the second Borel-Cantelli lemma makes these events occur infinitely often almost surely. Intersecting over positive integer even yields . For , the constant observable already fails to give limit zero. Thus the sharpness of the linear growth bound for integrable observables gives
Poincaré recurrence theorem Created 2026-09-24 Updated 2026-10-14
In a finite measure-preserving system, almost every point of every measurable set returns to infinitely often. The points of that never return form a wandering set: all its inverse images are pairwise disjoint and have equal measure, so that set must be null.
Shannon-McMillan-Breiman theorem Created 2026-10-05 Updated 2026-10-14
For a probability measure-preserving system and a countable measurable partition of finite entropy, converges almost everywhere and in to an invariant function whose integral is . For an ergodic transformation, the limit is the constant . In general it is . The martingale convergence theorem, maximal inequality for conditional information functions, and triangular ergodic averaging lemma prove this directly, without invertibility.
The finite positive measure representing an observable's autocorrelation sequence by the Bochner–Herglotz theorem. For a probability measure-preserving system, the Koopman operator is an isometry, so its forward autocorrelations, extended by complex conjugation to negative indices, form a positive-definite function on . The measure has mass , and its atoms are squared norms of projections onto Koopman operator eigenspaces, including for noninvertible transformations.
SZ property 2026-10-14
A probability measure-preserving system has the SZ property at level if the displayed lower limit is positive for every measurable set of positive measure. This convention counts nonzero shifts, hence progressions of length . The Furstenberg correspondence principle turns this property at all levels into the Szemerédi theorem. A compact measure-preserving system has the property because syndetic near returns of an almost periodic observable applied to an indicator give uniformly positive multiple intersections at bounded-gap times.
Suppose almost everywhere and in a probability measure-preserving system. Then
almost everywhere and in , where is the invariant sigma-algebra. For the almost-everywhere assertion, bound the terms with index at least by , apply the Birkhoff ergodic theorem, and then let . The finitely many remaining end terms vanish by the linear growth bound for integrable observables.