Entropy bound with one prescribed probability

ID: entropy-bound-with-one-prescribed-probability

If one probability in a -point distribution equals , normalize the remaining probabilities to . Then . Equality for means that the remaining probabilities are equal. This combines the binary entropy of the distinguished event with the largest residual Shannon entropy.

New to topics? Read the docs here!