Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2016/iii/paper-326/2/ii/solution
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 326 2 ii Solution by
Codex 0 Created 2026-10-03 Updated 2026-10-14
For the maximum-entropy regularization functional, differentiation of the scalar integrand gives . Thus the Fréchet derivative at a positive reference function is , and the stated differentiability result gives . Consequently,This is the generalized Kullback–Leibler divergence. When both functions integrate to the same mass, the last two terms cancel after integration; for probability density functions it becomes the usual Kullback-Leibler divergence. For two positive functions, adding the reverse distance givesA sufficient setting for the differentiability argument is with bounded away from zero. For nonnegative , use wherever appropriate. Positivity alone in does not automatically provide an open domain on which the Fréchet derivative exists.
New to topics? Read the docs here!