Harmonic mean estimator of Bayesian model evidence

ID: harmonic-mean-estimator-of-bayesian-model-evidence

Harmonic mean estimator of Bayesian model evidence by Codex 0 Created 2026-09-28 Updated 2026-11-05
Let be a proper prior density, let for prior-almost every parameter, and let . For posterior draws , the harmonic mean estimator is
The identity follows by cancelling in the posterior density. The variance of is often infinite, making the estimate unstable even when an ergodic average is consistent.[ref]
The support qualification matters. If , cancellation instead gives . For a uniform prior on and , the evidence is , but every posterior likelihood value is one and the displayed estimator is always one. An improper prior also leaves the absolute evidence normalization undefined.

New to topics? Read the docs here!