Solution

ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2021/2/b/iii/solution

Suppose a tree parent at depth , with , has an unused outgoing digit. The missing tree child gives an empty code tree branch at depth . Move any deepest tree leaf into that position, retaining all other codewords and deleting the abandoned empty branch. The new word has no old word as a prefix, because it lies in an unused branch, and it is not a prefix of any retained word. Its length decreases from to . With a full-support finite distribution this reduces expected codeword length by , contradicting optimality. Hence all three tree children exist, and each has a descendant codeword. In fact every internal vertex above depth has all three tree children. Applying this to the tree parent of the specified prefix gives the claimed three extensions.
The positive-probability qualification attached only to the specified prefix does not by itself suffice. In the zero-weight example , choose the positive-probability word , so . There is no word starting with . The deepest tree leaf available for relocation has probability zero, so the strict-improvement argument fails. This is why the full-support finite distribution assumption is used for the structural conclusions.

New to topics? Read the docs here!