Asymptotic equipartition property
= Asymptotic equipartition property
{wiki}
For a stationary source, typical long blocks have probability approximately $2^{-nH}$; equivalently normalized self-information converges to the entropy rate.
= Asymptotic equipartition property
{wiki}
For a stationary source, typical long blocks have probability approximately $2^{-nH}$; equivalently normalized self-information converges to the entropy rate.