Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 164 4 ii Solution Created 2026-09-24 Updated 2026-09-24
Write , , , and . Distances depend only on distributions, so all variables used in any one application may be realized as independent random variables.
First, the entropy submodularity for three independent sums impliesand analogously for . The Entropic Ruzsa triangle inequality gives and . Consequently the relevance of independent self-sums gives
Apply the Conditioned entropic Ruzsa distance of a summand first to and then to :Three applications of the Entropic Ruzsa triangle inequality giveAdding all these bounds yieldsThus the required absolute constants may be taken as and .
Past exam of the mathematics course of the University of Cambridge 2026 iii Paper 224 1 c Solution Created 2026-09-24 Updated 2026-09-24
Because the Entropic Ruzsa distance depends only on marginal distributions, take independent with the required marginals. Since is a function of , the data processing inequality for mutual information yieldsThe map is a bijection. Using independence and the chain rule for information entropy, the left side iswhereas the right side is . Hencewhere the final step is subadditivity of information entropy. Substituting this inequality into the definition of gives the Entropic Ruzsa triangle inequality
Past exam of the mathematics course of the University of Cambridge 2026 iii Paper 224 1 d Solution Created 2026-09-24 Updated 2026-09-24
Let be independent, with distributed as . Apply part (b) to :Adding an independent random variable cannot decrease information entropy, soIn terms of Entropic Ruzsa distance, this is . The Entropic Ruzsa triangle inequality and invariance under simultaneous negation now givewhich is the Entropic Ruzsa sum-difference inequality.
Relevance of independent self-sums Created 2026-09-24 Updated 2026-09-24
If is -relevant to and are mutually independent copies, then is -relevant to . The entropy submodularity for three independent sums impliesand similarly for . The Entropic Ruzsa triangle inequality boundswhich proves the claim after addition.