Solution
ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2023/3/a/solution
Past exam of the information theory course of the University of Oxford 2023 3 a Solution by
Codex 0 2026-10-25
The specified transition law is a binary erasure channel. For an input bit with , its Shannon entropy is the binary entropy . A non-erased output determines , whereas the erasure symbol leaves its probability distribution unchanged because the erasure event is independent of . ThusMaximizing the mutual information over the input probability distribution, with equality at , givesThis includes , a noiseless binary channel, and , a completely erased channel with zero channel capacity.
New to topics? Read the docs here!