Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 164 1 iii Solution Created 2026-09-24 Updated 2026-09-24
Because are independent random variables, adding is an independent noise channel, sois a Markov chain. The data processing inequality for mutual information givesTranslation in the finite additive group preserves conditional entropy, and independence therefore givesandSubstitution proves the required entropy submodularity for three independent sums.
Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 164 4 ii Solution Created 2026-09-24 Updated 2026-09-24
Write , , , and . Distances depend only on distributions, so all variables used in any one application may be realized as independent random variables.
First, the entropy submodularity for three independent sums impliesand analogously for . The Entropic Ruzsa triangle inequality gives and . Consequently the relevance of independent self-sums gives
Apply the Conditioned entropic Ruzsa distance of a summand first to and then to :Three applications of the Entropic Ruzsa triangle inequality giveAdding all these bounds yieldsThus the required absolute constants may be taken as and .
Past exam of the mathematics course of the University of Cambridge 2026 iii Paper 224 1 b Solution Created 2026-09-24 Updated 2026-09-24
Independence makesa Markov chain. The data processing inequality for mutual information therefore gives . Translation by the known value of is a bijection, so conditional entropy and independence giveand . Rearranging proves the stated entropy submodularity for three independent sums:
Relevance of independent self-sums Created 2026-09-24 Updated 2026-09-24
If is -relevant to and are mutually independent copies, then is -relevant to . The entropy submodularity for three independent sums impliesand similarly for . The Entropic Ruzsa triangle inequality boundswhich proves the claim after addition.