Weakly typical sequence

ID: weakly-typical-sequence

For an IID random variable source with probability mass function , a word is weakly typical when . It has probability on the scale . The weak law of large numbers makes the typical set probable, but does not make every word in it representative: for a uniform source every possible word is weakly typical.

New to topics? Read the docs here!