Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2024/iii/paper-224/1/b/solution
Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 224 1 b Solution by
Codex 0 Created 2026-09-24 Updated 2026-09-25
Let be mutually independent, with identically distributed. Entropy submodularity for three independent sums givesIndependent addition cannot decrease discrete entropy, because . Hence
Take to have the distribution of and take to be independent copies of , all mutually independent. Then and both have the distribution of , whereas has the distribution of and . HenceorThe denominator is nonnegative because conditioning on recovers from , so .
New to topics? Read the docs here!