Cantor Bernoulli measure 2026-10-05
The law of , for independent fair binary digits , is supported on the Cantor set. It is invariant and ergodic under , as the image of a Bernoulli shift. Each permitted ternary cylinder of length has measure , giving entropy rate . The Host equidistribution theorem makes almost every point a normal number in base , while its ternary digits omit .
One-sided generator 2026-10-05
A one-sided generator is a measurable partition with modulo null sets. Equivalently, every measurable set can be approximated in measure by unions of atoms of finite forward-name blocks. A one-sided coordinate partition generates a one-sided Bernoulli shift; for a nontrivial base distribution, it does not generate the two-sided version, whose negative coordinates are independent of the nonnegative ones.
On a probability measure-preserving system, for a finite measurable partition , the entropy of a finite measurable partition is
Use natural logarithms, so information entropy is measured in nats; another fixed logarithm base rescales all answers. The join of measurable partitions is their common refinement, and write , with an empty join the trivial partition. The entropy rate of a measurable partition and Kolmogorov-Sinai entropy are respectively
The block entropies form a subadditive sequence, so the first limit exists by the Fekete lemma. For finite partitions the conditional entropy of finite measurable partitions is .
Put and for . The chain rule for information entropy, applied from the last coordinate backwards, and measure preservation give
The second equality uses invariance of the joint partition atom probabilities under the common pullback ; invertibility is unnecessary. Since conditioning reduces entropy, decreases to a nonnegative limit . The Cesaro convergence of a sequence of this convergent sequence has the same limit. Therefore
Equivalently , where . Here conditional entropy of a countable measurable partition conditioned on a sigma-algebra is computed using conditional partition atom probabilities; the Martingale convergence theorem gives continuity under increasing conditioning sigma-algebras. This is the infinite-future formula for partition entropy rate.
The Kolmogorov-Sinai generator theorem states that if a finite or countable measurable partition has finite entropy of a countable measurable partition and its iterates generate the whole completed sigma-algebra modulo null sets, then . For an invertible system, generating means modulo null sets. For a noninvertible system a one-sided generator, using , suffices. The two-sided and one-sided versions must not be confused.
For a Bernoulli shift with discrete symbol probabilities , the coordinate-zero measurable partition has independent coordinate iterates. Thus
For a finite alphabet the coordinate partition is a generator of finite entropy of a finite measurable partition; on the two-sided sequence space use all integer coordinate iterates, and on the one-sided space use the nonnegative ones. The Kolmogorov-Sinai generator theorem proves the displayed answer in both cases. The same calculation applies to countably many symbols when their Shannon entropy is finite, using the countable finite-entropy version of the theorem. If the Shannon entropy is infinite, merge all but the first symbols into one cell. These finite coordinate partitions have entropy rate , so the system entropy is infinite. Zero-probability symbols contribute zero. In particular a fair -symbol shift has entropy .
For the final assertion, let and complete it modulo null sets. The approximation property forces modulo null sets. Indeed for each , choose approximating sets from finite blocks with error tending to zero. Their indicators approach in , and is a closed vector subspace, so is -measurable modulo a null set.
Invertibility now gives modulo null sets. In particular the present partition is measurable with respect to its entire future, so . The infinite-future formula gives . Since the given one-sided generator is also a two-sided generator, the Kolmogorov-Sinai generator theorem finishes the proof:
This is finite one-sided generator of an invertible system forces zero entropy. Invertibility is essential: a fair binary one-sided Bernoulli shift has a finite one-sided generator and Kolmogorov-Sinai entropy .
Use the probability-system convention . The Birkhoff ergodic theorem, also called the pointwise ergodic theorem, states that for a measure-preserving system and ,
where is the invariant sigma-algebra. The limit is integrable and has the same integral as . On a probability space the convergence also holds in , as in the allowed mean ergodic theorem. If is an ergodic transformation, is trivial modulo null sets, giving
The integer multiplication map on the circle preserves Lebesgue measure: for any integrable on ,
To prove the ergodicity of integer multiplication on the circle, suppose satisfies . Let be its Fourier coefficients in the Fourier basis . Since , the Fourier coefficients of at index are zero if does not divide , and are otherwise. This identity holds for all functions by approximation with trigonometric polynomials and the isometry . Invariance gives
Every nonzero integer can be divided by only finitely often. Thus for every , and completeness of the Fourier basis makes constant almost everywhere. Applying this to the indicator function of an invariant set gives measure zero or one, so
A normal number in base has every word of base- digits occurring with limiting overlapping frequency . Use the expansion that is not eventually equal to when there are two expansions. The word corresponds to the half-open interval
A word starting at position occurs exactly when . The Birkhoff ergodic theorem, applied to , gives frequency almost everywhere. There are countably many pairs , so their full-measure sets have a full-measure intersection. In particular,
These are absolutely normal numbers, so existence follows as well. This interval description also proves normality and equidistribution under integer multiplication: the base- intervals form arbitrarily fine grids, so their frequencies imply the correct frequency for every interval by approximation from inside and outside.
For the growth assertion, put . For every , the Tonelli theorem gives the useful summability bound
Since is a measure-preserving transformation, . The first Borel-Cantelli lemma shows that occurs only finitely often almost everywhere. Intersecting the resulting full-measure sets for proves the linear growth bound for integrable observables, . Multiplication by then gives
The threshold is sharp. For , choose with , and take the Bernoulli shift on with the product measure of independent uniform coordinates. The left shift preserves that measure because it preserves the probability of every finite-coordinate event. Define ; it is integrable because
The variables are independent. For any fixed ,
The probability sum diverges, so the second Borel-Cantelli lemma makes these events occur infinitely often almost surely. Intersecting over positive integer even yields . For , the constant observable already fails to give limit zero. Thus the sharpness of the linear growth bound for integrable observables gives
The Rudolph measure rigidity theorem has an essential ergodicity hypothesis. If a Borel probability measure on the circle group is invariant under both and , is ergodic for the semigroup generated jointly by these maps, and either map has positive Kolmogorov-Sinai entropy, then
Equivalently, a jointly ergodic common invariant measure other than Lebesgue measure has zero entropy for both maps. Joint ergodicity means that every set invariant modulo under both maps has measure zero or one. Positive entropy without this hypothesis is insufficient: , with a Dirac measure, is a common invariant measure of positive entropy and is not .
The Host equidistribution theorem states that if are relatively prime integers and is invariant and ergodic under , with , then for -almost every the sequence is an equidistributed sequence for Lebesgue measure. Explicitly, for every continuous on the circle,
The non-ergodic form assumes invariance and positive entropy for almost every component in the ergodic decomposition . Applying the ergodic theorem of Host on each such component gives the same almost-everywhere conclusion for . More generally, its conclusion holds on the part supported on positive-entropy components. A positive value of alone does not eliminate zero-entropy components.
To deduce the joint version of the Rudolph measure rigidity theorem, suppose ; if only has positive entropy, interchange the roles. Write the ergodic decomposition as . Since commutes with , its pushforward measure sends a ergodic component to a ergodic component . On each component, is a factor of a measure-preserving system with fibres of size at most three. We use the standard entropy preservation under a finite-to-one factor:
The reason for this standard entropy fact is that, conditional on a complete factor point, every finite orbit name has at most three possibilities; its conditional entropy is bounded by , and division by the orbit length gives zero relative entropy.
The component at is almost everywhere; this follows from commutation and the componentwise ergodic averages. The component entropy function is therefore invariant under both and . Joint ergodicity makes it constant almost everywhere, and affinity of entropy under ergodic decomposition identifies the constant as . Thus almost every component has positive entropy, exactly the condition required in the non-ergodic Host equidistribution theorem. It follows that -almost every point equidistributes for under .
For any continuous , invariance under and the dominated convergence theorem now give
Continuous functions determine Borel probability measures on the circle, so , proving the deduction.
For the normal-number example, let be independent fair binary digits and define
This Cantor Bernoulli measure is supported on the middle-third Cantor set . If is the Bernoulli shift, then on the circle. Consequently is invariant and ergodic: a invariant event pulls back to an invariant event, which has probability zero or one.
Take the ternary digit measurable partition . Its block partition of length has, up to null endpoints, positive-measure atoms under , each of measure , and all other atoms have measure zero. Hence
Apply the Host equidistribution theorem with , . For -almost every , the sequence equidistributes for Lebesgue measure, so is a normal number in base by normality and equidistribution under integer multiplication.
The ternary expansion of -almost every such contains only and , so the frequency of digit is zero rather than . The ambiguous ternary endpoints form a countable null set and can be removed. Therefore is not a normal number in base . We have proved the stronger almost-everywhere existence statement
An interval map has a horseshoe for an interval map when two disjoint subintervals are each mapped across a common interval. It is Glendinning-chaotic when one of its positive iterates has such a horseshoe.
Let the points of the three-cycle be and put , . There are two possible cyclic orders. If , the intermediate value theorem gives
for the interval covering relation. Thus there are two closed covering walks of length two based at . In the reverse cyclic order there are instead the arrows , and , again giving two closed walks of length two. The horseshoe from two closed covering walks therefore shows that has a horseshoe in either case, so is chaotic.
The Sharkovsky theorem orders the positive integers as
and says that a cycle of a given period forces cycles of every period to its right.
Suppose with odd. Then has a -cycle. The Sharkovsky theorem gives that map a six-cycle, and squaring it produces a three-cycle. Hence has a three-cycle and an iterate of has a horseshoe. Thus
A horseshoe contains the symbolic dynamics of the Bernoulli shift. Periodic binary words give cycles of every symbolic period; after translating from an iterate back to , this supplies cycles of many periods that are not powers of two.
For the logistic map, a ten-cycle would imply chaos because is not a power of two. Hence there is no ten-cycle for . A three-cycle forces every period, so a ten-cycle exists for . The stated facts alone give no conclusion for the intermediate range:
The Kolmogorov zero-one law says that for independent random variables , every event in the tail sigma-algebra
has probability zero or one.
In the canonical model of an independent and identically distributed sequence, the sample space is a sequence space with the product law, is the th coordinate, and the left Bernoulli shift satisfies . If is shift-invariant, then for every ,
so . The zero-one law therefore says that the canonical one-sided i.i.d. shift is ergodic.
For every , choose . On the Bernoulli shift over independent uniform coordinates in , the observable is integrable, but . The events are independent and their probabilities have divergent sum, so the Borel-Cantelli lemma implies that infinitely often almost surely. No exponent below one gives a universal bound for all integrable observables.