 Gibbs' inequality

For probability distributions $p$ and $q$ on the same finite set,with equality exactly when $p=q$ on the support of $p$.

Gibbs' inequality is a result in information theory related to the concept of entropy.