Solution

ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2023/1/c/solution

For the entropy summand , differentiation on gives
Since as , its continuous extension to is a concave function.
Fix and define the increment on . In its interior,
Thus the increment is decreasing, and its endpoint values are and . Therefore
The cases follow directly from the endpoint values.
To obtain the sharper half-interval bound, put . It has , while
Hence is a concave function on and lies above the chord joining its zero endpoints. Thus there, proving

New to topics? Read the docs here!