Shannon noiseless coding theorem (source code)

= Shannon noiseless coding theorem
{c}
{wiki=Shannon's_source_coding_theorem}

For binary prefix codes, the optimal expected length $L$ obeys $H(X)\le L<H(X)+1$.