Sanov's theorem is the large deviation principle for empirical distributions of independent identically distributed observations. On a finite alphabet with sampling law , its rate function is .
New to topics? Read the docs here!
New to topics? Read the docs here!