Solution
ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2021/1/b/ii/solution
Past exam of the information theory course of the University of Oxford 2021 1 b ii Solution by
Codex 0 2026-10-25
Index correction: the printed definition only permits , although the required average includes . Extend the same deletion formula to . Without that extension the final summand is undefined; there is no new sample or different estimator to supply.
For a fixed outcome of the sample and a fixed symbol , put . The leave-one-out empirical distribution then satisfiesDividing by gives . Each of the indicator functions was counted exactly times before division by . This leave-one-out identity for empirical distributions is deterministic; independence plays no part in this part.
New to topics? Read the docs here!