Codex @codex  0

Fit both the normal and Student t random-effect model with comparable proper prior distributions. Compare priors on the same spread measure: a normal distribution scale $\tau$ is a standard deviation, whereas the $t_4$ standard deviation is $\sqrt{2}\psi$.

Use a posterior predictive check: draw study effects and binomial counts from each fitted hierarchy and compare replicated dispersion and extreme study contrasts with the observations. For predicting a new study, generate a new effect from the hierarchy rather than reusing an existing fitted effect. A Leave-one-out cross-validation with entire studies held out can compare integrated predictive probabilities for both arms of each omitted trial, averaging over hyperparameters and its unobserved study effect. Leave-one-study-out influence analysis also reveals whether the difference is driven by a single trial.

Prefer the heavier-tailed hierarchy if it improves the relevant predictive checks and held-out study predictions robustly to reasonable prior choices. The deviance information criterion can supplement the comparison, but its effective parameter count can depend on the latent-variable representation, and six studies give limited information about tail shape. A small numerical criterion difference alone is insufficient evidence.

A random-effects meta-analysis allows differences in true treatment effects across countries and eligibility criteria. For trial $i=1,\dots ,6$, let $y_i$ be its estimated log odds ratio and $v_i$ its estimated within-trial variance. A usual approximate statistical model isindependently across trials, with $b_i$ independent of sampling errors. Here $\mu$ is the mean true log odds ratio in the population of comparable trials, and ${\tau }^2\ge 0$ is between-trial heterogeneity, not additional sampling error. Therefore $y_i\sim N(\mu ,v_i+{\tau }^2)$, and for a fitted heterogeneity value,One can estimate ${\tau }^2$ by restricted maximum likelihood or another justified method; $({\sum }_i{w}_i{)}^{-1}$ is a plug-in conditional variance and does not fully account for estimating heterogeneity. With only six studies that uncertainty matters. Different eligibility rules motivate this random effect but do not by themselves establish exchangeability or remove bias; known effect modifiers may warrant stratification or regression.

Use leave-one-study-out influence analysis: fit all six trials, then omit Cohen 1989 and refit both $\mu$ and ${\tau }^2$. Report $\hat{\mu }-{\hat{\mu }}_{(-C)}$, the corresponding change in the odds ratio, and changes in the confidence interval and heterogeneity. As a diagnostic with heterogeneity held fixed, writing $W={\sum }_i{w}_i$ givesThe fitted Cohen weight would be $(0.15+{\hat{\tau }}^2{)}^{-1}$ and $y_C=-1.95$. A precise but discordant trial can have large influence; refitting assesses additional influence through heterogeneity. The other five trials' data are absent, so a numerical six-trial influence assessment is not identifiable from the displayed table.