Solution

ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2023/3/a/solution

The specified transition law is a binary erasure channel. For an input bit with , its Shannon entropy is the binary entropy . A non-erased output determines , whereas the erasure symbol leaves its probability distribution unchanged because the erasure event is independent of . Thus
Maximizing the mutual information over the input probability distribution, with equality at , gives
This includes , a noiseless binary channel, and , a completely erased channel with zero channel capacity.

New to topics? Read the docs here!