 Epsilon-sufficient set

For a finite-valued random variable, an epsilon-sufficient set $S$ retains probability at least $1-ϵ$. This notion is about covering probability mass and is unrelated to a sufficient statistic. For an IID random variable source, any such set of words with fixed $ϵ<1$ requires exponentially many words at a rate approaching the Shannon entropy.