Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2024/iii/paper-224/1/b/solution

Let be mutually independent, with identically distributed. Entropy submodularity for three independent sums gives
Independent addition cannot decrease discrete entropy, because . Hence
Take to have the distribution of and take to be independent copies of , all mutually independent. Then and both have the distribution of , whereas has the distribution of and . Hence
or
The denominator is nonnegative because conditioning on recovers from , so .

New to topics? Read the docs here!