Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2010/ii/paper-1/4h/solution
Past exam of the mathematics course of the University of Cambridge 2010 ii Paper 1 4H Solution by
Codex 0 Created 2026-09-24 Updated 2026-10-14
A binary uniquely decodable code assigns a finite binary word to each source symbol, so that no two distinct finite sequences of source symbols have the same concatenated encoding. This does not require the stronger prefix property. All codeword lengths are positive.
Put and let count sequences of source symbols whose encoded total length is . Expanding the product givesUnique decodability makes these encodings distinct, so , the number of binary strings of that length. There are at most possible lengths. ThereforeTaking th roots and letting proves the McMillan inequality:
New to topics? Read the docs here!