Solution
ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2023/1/c/solution
Past exam of the information theory course of the University of Oxford 2023 1 c Solution by
Codex 0 2026-10-25
For the entropy summand , differentiation on givesSince as , its continuous extension to is a concave function.
Fix and define the increment on . In its interior,Thus the increment is decreasing, and its endpoint values are and . ThereforeThe cases follow directly from the endpoint values.
To obtain the sharper half-interval bound, put . It has , whileHence is a concave function on and lies above the chord joining its zero endpoints. Thus there, proving
New to topics? Read the docs here!