Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2022/iii/paper-224/4/d/solution

For , define the finite-alphabet exponential family
The mean is continuous and nondecreasing in , with limits and as and . The strict interior assumption on therefore supplies a with .
For any other satisfying the same constraint,
so
Equality in Gibbs inequality holds only for . Hence this Gibbs-form mass function is the unique entropy maximizer.

New to topics? Read the docs here!