Solution

ID: past-exam-of-the-advanced-topics-in-statistical-machine-learning-course-of-the-university-of-oxford/2025/1/c/iii/solution

The printed minimization of the evidence lower bound has no solution. To distinguish that literal result from the usual variational inference optimum, put . The preceding Kullback-Leibler divergence satisfies
Its unique global minimum occurs at . Since , this is the unique global maximum of the evidence lower bound:
The optimal common variance is the harmonic mean of the two posterior variances. However, as either or . Therefore
The source PDF confirms the minimization wording; replacing it by maximization would give the finite value above, consistently with part (i).

New to topics? Read the docs here!