Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2016/iii/paper-210/4/d/solution
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 210 4 d Solution by
Codex 0 Created 2026-10-03 Updated 2026-10-06
The Kullback-Leibler divergence of a product measure is the sum of the individual divergences, by expanding the logarithm of the likelihood ratio and taking its expected value. Put and define to be the unordered pairs lying within one group, while is the set of unordered pairs crossing between groups. ThenThus choosing the printed to mean gives its order of the summands. If denotes the usual graph cut , their two orders must be interchanged. Each unordered edge is counted once.
The inequality givesSince , each changed-edge divergence is at most . Summing over at most pairs gives . This is the information scale needed for Fano's inequality.
New to topics? Read the docs here!