Entropy rate of a measurable partition 2026-10-03
The entropy rate of isThe numerator is a subadditive sequence, so the limit exists and equals the infimum of the displayed ratios.
Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 108 3 Solution 2026-10-03
For a finite measurable partition ,Its conditional entropy of finite measurable partitions relative to isThe concavity of , equivalently conditioning reduces entropy, gives
SetThe chain rule and invariance give , so is a subadditive sequence. ThereforeThe Kolmogorov-Sinai entropy is over finite partitions.
Taking immediately shows that the infimum over arbitrary finite is at most . For the reverse inequality, apply Shearer's inequality to translates of a fixed finite inside a long interval. Every interior coordinate is covered times, while only boundary coordinates are lost. Subadditivity bounds the boundary contribution; division by the interval length and passage to the limit giveTaking the infimum proves
Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 214 1 b i Solution 2026-10-03
LetThe events and are increasing events of bond percolation. The FKG inequality and translation invariance giveThus is a subadditive sequence. Since every probability is positive for , Fekete lemma applies and gives