Minimum size of a sufficient set for an IID source

ID: minimum-size-of-a-sufficient-set-for-an-iid-source

For finite-alphabet independent and identically distributed random variables, fixed and , every epsilon-sufficient set of length- words satisfies for sufficiently large . Intersect with a typical set whose excluded mass is at most . The intersection retains that much probability and each word has probability at most .

New to topics? Read the docs here!