A common-effect synthesis treats study estimates as estimates of one shared effect. For independent approximately unbiased estimates with variances , use with . This model does not accommodate additional between-study heterogeneity.
The overall mean and the between-study heterogeneity encode different information. A proper broad normal distribution prior such as is one possible weak prior for the mean log odds ratio; information about the spread of trials alone does not determine its center.
A concrete prior calibration for normal random-effect range can make the factor-of-50 statement simultaneous across all six trials. Conditional on , each pair difference has normal distribution . Set , , and
For every , each pair exceeds in absolute value with probability at most . The union bound therefore gives , and integrating over the uniform prior preserves that bound. This is one explicit interpretation of “very unlikely”; a different elicited probability would change the bound. A smoother proper scale prior could be calibrated similarly.
The proposed improper prior is unsuitable. The observed-data likelihood function approaches the positive common-effect likelihood as . After restricting and the intercepts to a compact interior region, it is bounded below there by a positive constant. Hence
This is an improper posterior from a log-uniform random-effect scale prior. Proper conditional sampling distributions do not repair the improper joint posterior, and an arbitrary tiny cutoff would make inference depend on that cutoff.
The Student t random-effect model is useful when most studies are comparable but occasional genuine departures are more frequent than a normal distribution hierarchy allows. Its heavier tails permit a study effect far from without forcing a large common between-study heterogeneity scale on every study. In the Gaussian scale mixture representation, a small study-specific lowers its precision parameter and weakens its shrinkage.
Use this as robust partial pooling when occasional atypical effects are plausible. Known systematic population or design differences should still be modeled explicitly; a heavy tail cannot identify or correct within-study bias by itself.
Three distinct benefits of a meta-analysis are greater precision, an explicit synthesis of the effect, and assessment of variation across studies.
Combining compatible independent estimates can reduce the standard error, improve statistical power and provide more informative confidence intervals than individual small trials. A prespecified pooled estimate summarises the direction and magnitude of the evidence quantitatively, instead of informally counting statistically significant results. Finally, between-study heterogeneity and subgroup comparisons can reveal whether effects vary with populations or interventions, helping assess generalisability. These benefits require comparable estimands and an appraisal of study validity; pooling cannot repair systematic within-study bias.
Use for the inverse within-study variances, and . For Cochran's Q statistic, the DerSimonian–Laird estimator of the between-study variance is
Consequently the estimated heterogeneity variance and standard deviation are
These describe dispersion of underlying study log odds ratios, not ordinary sampling error of a single trial. The between-study heterogeneity is additional to the within-study variances.
The I-squared statistic is
It estimates the share of variation beyond that expected from sampling error in this collection of studies. Approximately half the variation is attributed to heterogeneity on that scale; this is neither the percentage of trials with different effects nor a percentage change in mortality. The PDF omits the symbol naming its heterogeneity estimate, so both and are reported explicitly.
Within-study bias is a systematic displacement of a study's effect estimate from its intended true effect because of its design, conduct, analysis or reporting. Examples include faulty allocation concealment, differential outcome assessment without suitable blinding, informative loss to follow-up, deviations from the intended treatment analysis, and selective reporting of outcomes or analyses. This differs from chance sampling error; the bias need not diminish as a study becomes larger.
It can shift a pooled meta-analysis effect and can create or obscure between-study heterogeneity. A random-effects meta-analysis accommodates dispersion, not systematic invalidity. Publication or non-inclusion of whole studies is a separate selection problem at the synthesis level.
Two useful approaches are risk-of-bias sensitivity analyses and explicit bias adjustment. First, appraise the relevant bias domains and compare the full synthesis with a prespecified synthesis restricted to studies with more credible methods, or stratify by those domains; discuss the resulting loss of precision and possible confounding of study characteristics. Second, if substantive information supports plausible bias magnitudes, use a bias-adjusted meta-analysis with uncertainty about those adjustments, and assess the effect across plausible values. Simply assigning a generic quality score or downweighting a study's sampling variance does not by itself remove its bias.