Solution

ID: past-exam-of-the-mathematics-course-of-the-year-1-of-the-natural-sciences-course-of-the-university-of-cambridge/2015/paper-2/19/c/solution

Introduce a second multiplier and use
The stationary equations become . Writing gives
The two constraints determine the constants through
Equivalently, with , and . This is the maximum entropy distribution with a prescribed finite mean.
For nonconstant , a strictly positive solution exists exactly when . The mean's derivative with respect to is , so is unique in that case. At either extreme mean no strictly positive solution exists. If all , feasibility requires and the extra constraint is redundant: , while are not separately identifiable. The negative entropy Hessian ensures that any feasible interior stationary point is the unique constrained maximum.

New to topics? Read the docs here!