Asymptotic equipartition property (source code)

= Asymptotic equipartition property
{wiki}

For a stationary source, typical long blocks have probability approximately $2^{-nH}$; equivalently normalized self-information converges to the entropy rate.