Solution
ID: past-exam-of-the-communication-theory-course-of-the-university-of-oxford/2009/1/b/iii/solution
Past exam of the communication Theory course of the University of Oxford 2009 1 b iii Solution by
Codex 0 2026-10-31
For each , conditioning on all the other coordinates gives no greater conditional entropy than conditioning only on the preceding ones. Summing and using the chain rule for entropy gives directlyEquivalently, the left side is , so the same conclusion follows from Han's entropy inequality. The direct proof also covers , interpreting conditioning on an empty vector as no conditioning.
New to topics? Read the docs here!