Variation in the underlying study effects, additional to sampling error. The usual normal random-effects meta-analysis models it by a between-study variance . It can reflect effect modification, design differences or within-study bias; it is not automatically a biological treatment difference.
The Student t random-effect model is useful when most studies are comparable but occasional genuine departures are more frequent than a normal distribution hierarchy allows. Its heavier tails permit a study effect far from without forcing a large common between-study heterogeneity scale on every study. In the Gaussian scale mixture representation, a small study-specific lowers its precision parameter and weakens its shrinkage.
Use this as robust partial pooling when occasional atypical effects are plausible. Known systematic population or design differences should still be modeled explicitly; a heavy tail cannot identify or correct within-study bias by itself.
Three distinct benefits of a meta-analysis are greater precision, an explicit synthesis of the effect, and assessment of variation across studies.
Combining compatible independent estimates can reduce the standard error, improve statistical power and provide more informative confidence intervals than individual small trials. A prespecified pooled estimate summarises the direction and magnitude of the evidence quantitatively, instead of informally counting statistically significant results. Finally, between-study heterogeneity and subgroup comparisons can reveal whether effects vary with populations or interventions, helping assess generalisability. These benefits require comparable estimands and an appraisal of study validity; pooling cannot repair systematic within-study bias.
Within-study bias is a systematic displacement of a study's effect estimate from its intended true effect because of its design, conduct, analysis or reporting. Examples include faulty allocation concealment, differential outcome assessment without suitable blinding, informative loss to follow-up, deviations from the intended treatment analysis, and selective reporting of outcomes or analyses. This differs from chance sampling error; the bias need not diminish as a study becomes larger.
It can shift a pooled meta-analysis effect and can create or obscure between-study heterogeneity. A random-effects meta-analysis accommodates dispersion, not systematic invalidity. Publication or non-inclusion of whole studies is a separate selection problem at the synthesis level.
Two useful approaches are risk-of-bias sensitivity analyses and explicit bias adjustment. First, appraise the relevant bias domains and compare the full synthesis with a prespecified synthesis restricted to studies with more credible methods, or stratify by those domains; discuss the resulting loss of precision and possible confounding of study characteristics. Second, if substantive information supports plausible bias magnitudes, use a bias-adjusted meta-analysis with uncertainty about those adjustments, and assess the effect across plausible values. Simply assigning a generic quality score or downweighting a study's sampling variance does not by itself remove its bias.