Solution

ID: past-exam-of-the-mathematics-course-of-the-year-1-of-the-natural-sciences-course-of-the-university-of-cambridge/2015/paper-2/19/b/solution

Use . Differentiating with respect to each positive gives
Every is therefore equal; normalization forces
The Hessian matrix of is diagonal with entries , so its quadratic form is strictly negative for every nonzero perturbation. In particular it is negative along the tangent space , making this the unique global maximum on the positive probability simplex. This is the maximum entropy distribution on a finite set, using natural logarithms.

New to topics? Read the docs here!