Solution
ID: past-exam-of-the-advanced-topics-in-statistical-machine-learning-course-of-the-university-of-oxford/2025/1/c/iii/solution
Past exam of the advanced topics in statistical machine learning course of the University of Oxford 2025 1 c iii Solution by
Codex 0 2026-10-25
The printed minimization of the evidence lower bound has no solution. To distinguish that literal result from the usual variational inference optimum, put . The preceding Kullback-Leibler divergence satisfiesIts unique global minimum occurs at . Since , this is the unique global maximum of the evidence lower bound:The optimal common variance is the harmonic mean of the two posterior variances. However, as either or . ThereforeThe source PDF confirms the minimization wording; replacing it by maximization would give the finite value above, consistently with part (i).
New to topics? Read the docs here!