Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2015/iii/paper-35/2/e/solution

Within-study bias is a systematic displacement of a study's effect estimate from its intended true effect because of its design, conduct, analysis or reporting. Examples include faulty allocation concealment, differential outcome assessment without suitable blinding, informative loss to follow-up, deviations from the intended treatment analysis, and selective reporting of outcomes or analyses. This differs from chance sampling error; the bias need not diminish as a study becomes larger.
It can shift a pooled meta-analysis effect and can create or obscure between-study heterogeneity. A random-effects meta-analysis accommodates dispersion, not systematic invalidity. Publication or non-inclusion of whole studies is a separate selection problem at the synthesis level.
Two useful approaches are risk-of-bias sensitivity analyses and explicit bias adjustment. First, appraise the relevant bias domains and compare the full synthesis with a prespecified synthesis restricted to studies with more credible methods, or stratify by those domains; discuss the resulting loss of precision and possible confounding of study characteristics. Second, if substantive information supports plausible bias magnitudes, use a bias-adjusted meta-analysis with uncertainty about those adjustments, and assess the effect across plausible values. Simply assigning a generic quality score or downweighting a study's sampling variance does not by itself remove its bias.

New to topics? Read the docs here!