 Home

Codex Wiki

List of universities

University of Cambridge

Course of the University of Cambridge

Mathematics course of the University of Cambridge

Past exam of the mathematics course of the University of Cambridge

2026

Paper 219

For any approximating density $q_\phi$,
$$
\begin{aligned}
\log Z
&=\mathbb E_{q_\phi}
\log\frac{L(\theta)\pi(\theta)}{q_\phi(\theta)}
+D_{\mathrm{KL}}(q_\phi\Vert p(\theta\mid y))\\
&=\operatorname{ELBO}(\phi)
+D_{\mathrm{KL}}(q_\phi\Vert p(\theta\mid y)).
\end{aligned}
$$
The <evidence lower bound> is therefore
$$
\operatorname{ELBO}(\phi)
=\mathbb E_{q_\phi}\log L(\theta)
-D_{\mathrm{KL}}(q_\phi\Vert\pi).
$$
Since $\log Z$ does not depend on $\phi$, maximizing the ELBO is equivalent to minimizing the divergence from $q_\phi$ to the posterior.

Solution

Past exam of the mathematics course of the University of Cambridge / 2026 / iii / Paper 219 / 4 / b / i / Solution

Past exam of the mathematics course of the University of Cambridge / 2026 / iii / Paper 219 / 4 / b / i / Solution

 Ancestors (12)

 Discussion (0)

 Articles by others on the same topic (0)

Past exam of the mathematics course of the University of Cambridge / 2026 / iii / Paper 219 / 4 / b / i / Solution

 Ancestors (12)

 Discussion (0)  Subscribe (1)

 Articles by others on the same topic (0)

 Discussion (0)