For Bayesian deviance under a common likelihood convention, define and . Then trades average fit against effective complexity. Lower values suggest better penalized predictive fit in comparable models; differences are not Bayes factors or model posterior probabilities. The choice of stochastic parameters and latent-variable representation matters, especially in a hierarchical Bayesian model.
The DIC effective parameter count compares mean Bayesian deviance with deviance at the posterior mean. It need not be an integer or equal the number of coefficients. Interpretation depends on the parameterization and the chosen observational likelihood; nuisance intercepts count when they appear in that likelihood.
Suppose the Bayesian deviance is locally with positive-definite , and the posterior is normal with mean and covariance . Writing , expectation and variance of the quadratic form giveConsequently the usual effective parameter count in DIC is , whereas half the deviance variance is . A locally flat prior gives and , so both counts equal the parameter dimension. Informative priors generally destroy their equality. The expectation formula requires only the first two moments; normality is used for the variance formula.
Articles by others on the same topic
The Deviance Information Criterion (DIC) is a statistical tool used for model selection in the context of Bayesian statistics. It is specifically designed for hierarchical models and is particularly useful when comparing models with different complexities. The DIC is composed of two main components: 1. **Deviance**: This is a measure of how well a model fits the data.