Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 108 (Topics in Ergodic Theory)

A continuous transformation $T$ of a compact metric space $X$ is uniquely ergodic when there is exactly one $T$-invariant Borel probability measure on $X$. We use the usual compact-space convention for unique ergodicity; the compactness and continuity hypotheses matter in the assertion about all starting points.

Let $R_{\alpha }(x)=x+\alpha (\mathrm{mod}1)$ on the circle group, with $\alpha$ irrational. Normalized Lebesgue measure $m$ is invariant under this irrational rotation of the circle. If $\nu$ is any invariant Borel probability measure, define its Fourier coefficients by $c_k=\int e^{2\pi ikx}d\nu (x)$. Invariance givesFor $k\ne 0$, irrationality makes $e^{2\pi ik\alpha }\ne 1$, so $c_k=0$; also $c_0=1$. These are the Fourier coefficients of $m$. Hence $\nu$ and $m$ have the same integrals against every trigonometric polynomial. Such polynomials are uniformly dense in the continuous functions by the Stone-Weierstrass theorem, so the measures agree on every continuous test function and therefore agree as Borel measures. Thus

For the general uniquely ergodic system, fix $x\in X$ and form the empirical measuresOn a compact metric space, the Borel probability measures are compact for weak convergence of probability measures. Any subsequential limit $\nu$ is invariant: for every continuous $g$,Here $g$ is bounded and $g\circ T$ is continuous, so the identity passes to the limit. Uniqueness of the invariant Borel probability measure gives $\nu =\mu$. Every subsequential limit is therefore $\mu$, and compactness implies convergence of the entire sequence. Testing against $f$ provesIn fact this proves uniform ergodic convergence for uniquely ergodic systems: if convergence were not uniform in $x$, choose $N_j\to \infty$ and $x_j$ where the discrepancy stays above a fixed positive number. The same compactness and telescoping argument applied to ${\nu }_{N_j,x_j}$ forces a subsequence to converge to $\mu$, a contradiction. This also makes clear why an almost-everywhere Birkhoff ergodic theorem alone would not establish the requested everywhere assertion. Without the compact-space hypothesis the assertion need not hold: on the discrete space $\{p\}\bigsqcup {\mathbb{Z}}_{\ge 0}$, set $T(p)=p$ and $T(n)=n+1$. The only invariant probability is ${\delta }_p$, but the continuous bounded function which is zero at $p$ and one on the integer orbit has orbit average one there.

For the decimal application put $\alpha ={\log }_{10}2$. This is irrational: if $\alpha =p/q$ with positive integers $p,q$, then $2^q=10^p=2^p{5}^p$, contradicting unique prime factorization. Writing $n\alpha =m_n+t_n$ with $m_n=\lfloor n\alpha \rfloor$ and $t_n\in [0,1)$ gives $2^n=10^{m_n}10^{t_n}$. Its leading decimal digit is seven exactly whenThe half-open upper endpoint correctly excludes powers whose leading digit is eight, including $2^3=8$.

The indicator of $I$ is not continuous, so an extra step is needed. For any $\epsilon >0$, choose continuous functions $a_{\epsilon },b_{\epsilon }$ on the circle with $0\le a_{\epsilon }\le 1_I\le b_{\epsilon }\le 1$ and $\int (b_{\epsilon }-a_{\epsilon })dm<\epsilon$, by tapering in small neighbourhoods of the two endpoints. Applying the everywhere averaging result to these functions traps the lower and upper limits of the interval frequency between their integrals. Letting $\epsilon \downarrow 0$ proves everywhere interval frequency under an irrational rotation. ConsequentlyThis is the leading-seven case of Benford frequencies for powers of an integer.

For a probability measure-preserving system, strong mixing means that for every pair of measurable sets $A,B$,A sequence $a_n$ has convergence in density of a sequence to $a$ when for each $\epsilon >0$ the exceptional set $\{n:|a_n-a|\ge \epsilon \}$ has natural density zero. A weakly mixing measure-preserving transformation has convergence in density of $\mu (T^{-n}A\cap B)$ to $\mu (A)\mu (B)$ for every $A,B$. Equivalently, because these correlations are bounded,Indeed the mean of the absolute discrepancy is at least $\epsilon$ times the exceptional frequency, while it is at most $\epsilon$ plus a uniform bound times that frequency. A signed Cesaro convergence of a sequence without absolute values is insufficient to define weak mixing.

The standard three-cut Chacon map is obtained by cutting and stacking. Start on $[0,1)$ with normalized Lebesgue measure, an initial tower consisting of $[0,2/3)$, and a reservoir $[2/3,1)$ for spacers. At stage $j$, cut every level of the current tower into three equal subintervals, producing three subcolumns. Add one new interval of the same width above the middle subcolumn. Stack the first subcolumn at the bottom, then the middle subcolumn with its spacer, then the third at the top. Define the partial transformation by translation from each level to the next, leaving the current top unmapped. These assignments extend the earlier partial transformation. Repeat indefinitely.

If $h_j$ is the number of levels and $w_j$ their width, thenHence $h_j=(3^{j+1}-1)/2$, $w_j=2/3^{j+1}$, and the stage-$j$ tower has measure $1-3^{-j-1}$. The spacers consume total measure ${\sum }_{j\ge 0}{w}_{j+1}=1/3$, precisely the reservoir. The increasing partial maps give the Chacon map modulo null sets. The tower tops and unused reservoir have measures tending to zero, and the construction yields an invertible measure-preserving transformation. With $0$ marking an original level and $1$ a spacer, the tower words satisfy $W_0=0$ and $W_{j+1}=W_j{W}_{j}1W_j$, so the first new word is $0010$. This describes the spacer placement without needing a proof of well-definedness. The three-cut convention agrees with the classical constant spacer vector $(0,1,0)$ described in Ryzhikov's construction.

For the correlation assertion, take the L2 inner product to be $⟨u,v⟩=\int u\overline{v}d\mu$, linear in its first argument, and put $U=U_T$. The Koopman operator is an isometry on $L^2$, even when $T$ is not invertible. For $n\ge k$ the hint givesTo extend rigorously to all test functions, centre the observable: $v=f-a1$. Invariance of the integral gives $⟨U^{n}v,v⟩=⟨U^{n}f,f⟩-|a{|}^2\to 0$. LetFor each fixed $k$, $⟨U^{n}v,U^{k}v⟩\to 0$ by the same isometry identity. Therefore the limit is zero for every finite linear combination of these orbit vectors. By the Cauchy-Schwarz inequality and $\Vert U^{n}v{\Vert }_2=\Vert v{\Vert }_2$, approximation extends this conclusion to every $g\in M$: the approximation error in the correlation is bounded by $\Vert v{\Vert }_2\Vert g-g_0{\Vert }_2$ uniformly in $n$. For $g\in M^{\perp }$, the correlation is identically zero because $U^{n}v\in M$. The orthogonal decomposition by a closed subspace now gives the result for all $g\in L^2$. ThusThis is decay of autocorrelation implies weak convergence of an observable; no assumption that $T$ is an ergodic transformation, and no invertibility hypothesis was used, and $a=0$ is included.

Finally, strong mixing immediately implies the stated diagonal limit by taking $B=A$. Conversely, suppose that limit holds for every $A$. Apply the correlation result with $f=1_A$ and $g=1_B$. Its hypothesis is exactly $⟨U^n{1}_A,1_A⟩\to \mu (A{)}^2$, and its conclusion isHence strong mixing is equivalent to diagonal set-correlation criterion for mixing. Using the orbit-span proof avoids an invalid polarization argument that would recover only the sum of the two directed cross-correlations from diagonal correlations.

On a probability measure-preserving system, for a finite measurable partition $\xi =\{A_1,\dots ,A_r\}$, the entropy of a finite measurable partition isUse natural logarithms, so information entropy is measured in nats; another fixed logarithm base rescales all answers. The join of measurable partitions is their common refinement, and write ${\xi }_a^b={\bigvee }_{j=a}^b{T}^{-j}\xi$, with an empty join the trivial partition. The entropy rate of a measurable partition and Kolmogorov-Sinai entropy are respectivelyThe block entropies form a subadditive sequence, so the first limit exists by the Fekete lemma. For finite partitions the conditional entropy of finite measurable partitions is $H(\eta \mid \zeta )=H(\eta \vee \zeta )-H(\zeta )$.

Put $c_0=H(\xi )$ and $c_k=H(\xi \mid {\xi }_1^k)$ for $k\ge 1$. The chain rule for information entropy, applied from the last coordinate backwards, and measure preservation giveThe second equality uses invariance of the joint partition atom probabilities under the common pullback $T^{-j}$; invertibility is unnecessary. Since conditioning reduces entropy, $c_k$ decreases to a nonnegative limit $c$. The Cesaro convergence of a sequence of this convergent sequence has the same limit. ThereforeEquivalently $h_{\mu }(T,\xi )=H_{\mu }(\xi \mid {\mathcal{F}}_1)$, where ${\mathcal{F}}_1=\sigma ({\bigvee }_{j\ge 1}{T}^{-j}\xi )$. Here conditional entropy of a countable measurable partition conditioned on a sigma-algebra is computed using conditional partition atom probabilities; the martingale convergence theorem gives continuity under increasing conditioning sigma-algebras. This is the infinite-future formula for partition entropy rate.

The Kolmogorov-Sinai generator theorem states that if a finite or countable measurable partition $\eta$ has finite entropy of a countable measurable partition and its iterates generate the whole completed sigma-algebra modulo null sets, then $h_{\mu }(T)=h_{\mu }(T,\eta )$. For an invertible system, generating means $\sigma ({\bigvee }_{j\in \mathbb{Z}}{T}^{-j}\eta )=\mathcal{B}$ modulo null sets. For a noninvertible system a one-sided generator, using $j\ge 0$, suffices. The two-sided and one-sided versions must not be confused.

For a Bernoulli shift with discrete symbol probabilities $(p_i)$, the coordinate-zero measurable partition has independent coordinate iterates. ThusFor a finite alphabet the coordinate partition is a generator of finite entropy of a finite measurable partition; on the two-sided sequence space use all integer coordinate iterates, and on the one-sided space use the nonnegative ones. The Kolmogorov-Sinai generator theorem proves the displayed answer in both cases. The same calculation applies to countably many symbols when their Shannon entropy is finite, using the countable finite-entropy version of the theorem. If the Shannon entropy is infinite, merge all but the first $r$ symbols into one cell. These finite coordinate partitions have entropy rate $-{\sum }_{i\le r}{p}_i\log p_i-p_{>r}\log p_{>r}\to \infty$, so the system entropy is infinite. Zero-probability symbols contribute zero. In particular a fair $r$-symbol shift has entropy $\log r$.

For the final assertion, let ${\mathcal{F}}_0=\sigma ({\bigvee }_{j\ge 0}{T}^{-j}\xi )$ and complete it modulo null sets. The approximation property forces ${\mathcal{F}}_0=\mathcal{B}$ modulo null sets. Indeed for each $A\in \mathcal{B}$, choose approximating sets from finite blocks with error tending to zero. Their indicators approach $1_A$ in $L^2$, and $L^2({\mathcal{F}}_0)$ is a closed vector subspace, so $A$ is ${\mathcal{F}}_0$-measurable modulo a null set.

Invertibility now gives ${\mathcal{F}}_1=T^{-1}{\mathcal{F}}_0=T^{-1}\mathcal{B}=\mathcal{B}$ modulo null sets. In particular the present partition $\xi$ is measurable with respect to its entire future, so $H(\xi \mid {\mathcal{F}}_1)=0$. The infinite-future formula gives $h_{\mu }(T,\xi )=0$. Since the given one-sided generator is also a two-sided generator, the Kolmogorov-Sinai generator theorem finishes the proof:This is finite one-sided generator of an invertible system forces zero entropy. Invertibility is essential: a fair binary one-sided Bernoulli shift has a finite one-sided generator and Kolmogorov-Sinai entropy $\log 2$.

For a probability measure-preserving system, the hypothesis is completely positive entropy: every finite measurable partition with positive static entropy of a finite measurable partition has positive entropy rate of a measurable partition. Fix a finite partition $\xi$ and putAll sigma-algebras are interpreted modulo null sets. We will prove that every finite partition $\alpha$ measurable with respect to this tail sigma-algebra of a measurable partition has $h_{\mu }(T,\alpha )=0$. Applying this to a binary partition will force the required triviality. This proves the needed direction of the Tail characterization of the Pinsker sigma-algebra directly, including noninvertible transformations.

Write $h=h_{\mu }(T,\xi )$. The infinite-future entropy formula and the backwards chain rule for information entropy give, for every $L\ge 1$, the block conditional entropy given the infinite future identityEach term equals $h$ by invariance of the joint probabilities under a common pullback and continuity of conditional entropy under increasing finite future blocks. Invertibility is not needed for this identity.

Fix $\epsilon >0$. Since $\alpha$ is ${\mathcal{F}}_0$-measurable and finite, the martingale convergence theorem and continuity of finite-partition conditional entropy allow an $r\ge 0$ withTo see the continuity explicitly, for each partition atom $A$ of $\alpha$ the conditional probabilities $\mathbb{E}[1_A\mid \sigma ({\xi }_0^r)]$ tend to $1_A$ almost everywhere; apply dominated convergence theorem to the bounded continuous function $-t\log t$ on $[0,1]$ and sum over the finitely many partition atoms.

For $n\ge 1$ set $\gamma ={\alpha }_0^{n-1}$, $L=n+r$, and $\beta ={\xi }_0^{L-1}$. The conditional entropy of finite measurable partitions satisfiesThe second inequality uses conditioning reduces entropy, since $\beta$ refines each block $T^{-j}{\xi }_0^r$; the final equality uses measure preservation.

Moreover $\gamma$ is ${\mathcal{F}}_L$-measurable. For each $j\ge 0$, tail measurability gives $\alpha$ measurable with respect to ${\mathcal{F}}_L$, hence $T^{-j}\alpha$ measurable with respect to $T^{-j}{\mathcal{F}}_L={\mathcal{F}}_{L+j}\subseteq {\mathcal{F}}_L$. Thus conditioning reduces entropy and the displayed block identity implyUse the symmetric entropy identity $H(\gamma )=H(\beta )-H(\beta \mid \gamma )+H(\gamma \mid \beta )$ to obtainThe fraction on the right tends to zero: $r$ is fixed and $H({\xi }_0^{n+r-1})/(n+r)\to h$ by the definition of entropy rate of a measurable partition. Taking $n\to \infty$ and then $\epsilon \downarrow 0$ gives

Now let $A\in \mathcal{T}(\xi )$ and take $\alpha =\{A,X\setminus A\}$. If $0<\mu (A)<1$, its binary entropy is $-\mu (A)\log \mu (A)-(1-\mu (A))\log (1-\mu (A))>0$, while its entropy rate is zero, contradicting completely positive entropy. ThereforeSince $\xi$ was arbitrary, every finite-partition tail is trivial. The argument needs only that $\xi$ is finite and the measure is a probability; it does not assume a finite generator, finite total system entropy, or invertibility.