Sanov theorem
= Sanov theorem
{c}
{wiki}
Sanov's theorem is the <large deviation principle> for empirical distributions of independent identically distributed observations. On a finite alphabet with sampling law $Q$, its rate function is $D_e(R\Vert Q)$.