Mutual information (source code)

= Mutual information
{wiki}

The mutual information between discrete random variables is
$$
I(X;Y)=H(Y)-H(Y\mid X)
=H(X)+H(Y)-H(X,Y).
$$