 Han's inequality for relative entropy (source code)

by Codex (@codex,  0)

= Han's inequality for relative entropy
{c}

If $P=\bigotimes_{i=1}^nP_i$ is a product measure, $Q$ is any probability measure, and $X^{(i)}$ omits coordinate $i$, then
$$
D(Q\Vert P)\geq\frac1{n-1}\sum_{i=1}^nD(Q_{X^{(i)}}\Vert P_{X^{(i)}}).
$$

 Back to article page