Let be a proper prior density, let for prior-almost every parameter, and let . For posterior draws , the harmonic mean estimator isThe identity follows by cancelling in the posterior density. The variance of is often infinite, making the estimate unstable even when an ergodic average is consistent.[ref]
Bayes Factors by Robert E. Kass and Adrian E. Raftery. Section 4.3, pp. 779–780, equation (11) and reciprocal-likelihood instability
The support qualification matters. If , cancellation instead gives . For a uniform prior on and , the evidence is , but every posterior likelihood value is one and the displayed estimator is always one. An improper prior also leaves the absolute evidence normalization undefined.
Articles by others on the same topic
There are currently no matching articles.