Strongly typical sequence
= Strongly typical sequence
For a finite-alphabet <IID random variable> source, a strongly typical word has empirical symbol frequencies within the chosen tolerance of every $p(x)$, and contains no zero-probability symbols. Unlike a <weakly typical sequence>, this definition controls the individual symbol counts. Both definitions give sets whose probability tends to one for fixed positive tolerance.