Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2024/ii/paper-1/11k/c/solution

Shannon second coding theorem states that the operational capacity of a discrete memoryless channel equals
every rate below is achievable with error probability tending to zero, while rates above are not.
Put . If , then , so is recovered exactly and bit. If , the two output supports
are disjoint, so again determines and .
If , one output value is common to both inputs and occurs with probability independently of the input, while either of the other two values reveals the input. The channel is therefore a binary erasure channel with erasure probability , whose capacity is bit. Hence

New to topics? Read the docs here!