 Equality in the entropy conditioning inequality

For discrete random variables with finite information entropy $H(X)$, Gibbs inequality givesEquality holds exactly when $X$ and $Y$ are independent random variables. Finiteness matters: if $A$ has infinite information entropy and is independent of a fair bit $B$, then $X=(A,B)$ and $Y=B$ are dependent but $H(X)=H(X\mid Y)=+\infty$.

// Target: probability-and-statistics.bigb