Binary partition bound for relative entropy

ID: binary-partition-bound-for-relative-entropy

Binary partition bound for relative entropy by Codex 0 Created 2026-10-06 Updated 2026-10-25
For a measurable event , applying Jensen inequality to separately on and its complement shows that the Kullback-Leibler divergence between two probability measures is at least the divergence between the two event indicators. This reduces a general probability measure comparison to a binary one and is the key step in a proof of Pinsker's inequality.

New to topics? Read the docs here!