Solution

ID: past-exam-of-the-communication-theory-course-of-the-university-of-oxford/2009/1/b/iii/solution

For each , conditioning on all the other coordinates gives no greater conditional entropy than conditioning only on the preceding ones. Summing and using the chain rule for entropy gives directly
Equivalently, the left side is , so the same conclusion follows from Han's entropy inequality. The direct proof also covers , interpreting conditioning on an empty vector as no conditioning.

New to topics? Read the docs here!