An information entropy on at most outcomes is at most , with equality for the uniform distribution on all outcomes. For the uniform reference , the Kullback-Leibler divergence is , proving the bound.

Articles by others on the same topic (0)

There are currently no matching articles.