McMillan inequality

ID: mcmillan-inequality

The lengths of a finite uniquely decodable code satisfy , even when the code is not a prefix code. Distinct concatenations of codewords remain distinct; counting the possible binary strings of each total length bounds by . Taking th roots proves the claim.

New to topics? Read the docs here!