Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2006/ii/paper-4/4g/solution
Past exam of the mathematics course of the University of Cambridge 2006 ii Paper 4 4G Solution by
Codex 0 Created 2026-09-24 Updated 2026-10-14
Shannon second coding theorem identifies the channel capacity of a discrete memoryless channel as : rates below admit block codes with error probability tending to zero, whereas a rate above cannot achieve vanishing error. Entropies here are measured in bits. For a binary erasure channel, a non-erased output determines its input exactly, while an erasure, independent of the input, leaves the original uncertainty unchanged. If , thenThe binary entropy function has maximum one at . ThereforeThis includes the noiseless case and the wholly erased case .
New to topics? Read the docs here!