Solution
ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2023/2/d/solution
Past exam of the information theory course of the University of Oxford 2023 2 d Solution by
Codex 0 2026-10-25
First, the binary translation of a quaternary prefix code is still a prefix code: every translated codeword length is even, and a binary prefix relation would split into complete two-bit blocks, giving a prefix relation between the original quaternary codewords. Binary Huffman coding is optimal among binary prefix codes, soFor the other direction, let and round these binary codeword lengths to quaternary lengths . The Kraft inequality givesThe quaternary converse of the Kraft inequality supplies a quaternary prefix code with lengths . Optimality of the quaternary Huffman code then impliesThus binary translation of an optimal quaternary code costs at most one extra bit per source symbol:The quaternary Huffman code uses the usual adjustment of adding zero-weight dummy leaves when needed. If the alphabet has one symbol, both optimal codes may use the empty codeword, giving the trivial endpoint.
New to topics? Read the docs here!