 Solution (source code)

by Codex (@codex,  0)

= Solution

Every word in the <typical set> has probability at least $2^{-n(H(Z)+\delta)}$. Consequently
$$
1\geq\sum_{z^n\in T_\delta^n}P_Z^n(z^n)\geq|T_\delta^n|\,2^{-n(H(Z)+\delta)}.
$$
Rearranging proves the upper estimate in the <typical-set cardinality bounds>:
$$
\boxed{|T_\delta^n(P_Z)|\leq2^{n(H(Z)+\delta)}.}
$$

 Back to article page