The Kullback-Leibler divergence of a product measure is the sum of the individual divergences, by expanding the logarithm of the likelihood ratio and taking its expected value. Put and define to be the unordered pairs lying within one group, while is the set of unordered pairs crossing between groups. Then
Thus choosing the printed to mean gives its order of the summands. If denotes the usual graph cut , their two orders must be interchanged. Each unordered edge is counted once.
The inequality gives
Since , each changed-edge divergence is at most . Summing over at most pairs gives . This is the information scale needed for Fano's inequality.

Articles by others on the same topic (0)

There are currently no matching articles.