Past exam of the statistics course of the University of Oxford / 2017 / 3 / b / i / Solution

For a specified posterior probability $1-\alpha$, an interval $I=({\theta }_1,{\theta }_2)$ is a highest posterior density interval ifand every included point has posterior density at least as large as every excluded point, apart from boundary and null-set choices. Equivalently, $I$ is a level set $\{\theta :\pi (\theta \mid x)>k\}$, with possible choices on its boundary, whose posterior probability is $1-\alpha$.

This selects the most densely supported values of the statistical parameter. When the relevant level set is one interval and has no plateau of positive probability, it is the shortest credible interval of that posterior probability. With several separated peaks, the corresponding highest density region can instead be disconnected, so an interval need not exist. The definition is in the stated parameter coordinate: posterior density ordering can change under a nonlinear change of parameter.