Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2016/iii/paper-326/2/ii/solution

For the maximum-entropy regularization functional, differentiation of the scalar integrand gives . Thus the Fréchet derivative at a positive reference function is , and the stated differentiability result gives . Consequently,
This is the generalized Kullback–Leibler divergence. When both functions integrate to the same mass, the last two terms cancel after integration; for probability density functions it becomes the usual Kullback-Leibler divergence. For two positive functions, adding the reverse distance gives
A sufficient setting for the differentiability argument is with bounded away from zero. For nonnegative , use wherever appropriate. Positivity alone in does not automatically provide an open domain on which the Fréchet derivative exists.

New to topics? Read the docs here!