Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2024/iii/paper-208/2/e/solution

Yes. Write and . The bounds from b and d are respectively
The Strong form of Han's entropy inequality, obtained by repeated entropy submodularity, states
After replacing entropies by divergences from the product reference, whose cross-entropy terms cancel, this is exactly . Equality holds for product and when ; dependence can make the new bound strictly smaller.

New to topics? Read the docs here!