Anaes · Measurement & monitoring physics
Bias and confounding in clinical research
Also known as Bias · Confounding · Selection bias · Performance bias · Detection bias · Attrition bias · Reporting bias · Effect modification · Propensity scoring
Every anaesthetic reads the literature, and every paper is threatened by two families of error that can make a useless intervention look effective or a harmful one look safe — bias and confounding. The model rests on eleven exam-critical ideas. First, BIAS is a SYSTEMATIC error that distorts the study findings in a particular direction, unlike RANDOM error (chance) which is unsystematic. Second, SELECTION BIAS is a systematic difference between those selected for study and those not — minimised by randomisation with allocation concealment, and exposed when concealment is subverted. Third, PERFORMANCE BIAS is a systematic difference in the care provided apart from the intervention, minimised by blinding participants and clinicians. Fourth, DETECTION BIAS is a systematic difference in how outcomes are assessed, minimised by blinded outcome assessors and standardised measurement. Fifth, ATTRITION BIAS is systematic loss during follow-up that differs between groups, handled by intention-to-treat analysis alongside per-protocol analysis. Sixth, REPORTING BIAS is the selective publication of favourable results — screened by funnel-plot asymmetry, with prevention by prospective registration and CONSORT reporting as the best defence. Seventh, a CONFOUNDER is a third variable associated with BOTH the exposure and the outcome but NOT on the causal pathway. Eighth, CONFOUNDING is a nuisance to be eliminated whereas EFFECT MODIFICATION is a real interaction to be reported. Ninth, in the DESIGN phase, RANDOMISATION is the only method that controls for both known and UNKNOWN confounders. Tenth, in the ANALYSIS phase, stratified analysis, multivariable regression and PROPENSITY-SCORE methods estimate effects from non-randomised data within their assumptions and limitations. Eleventh, RESIDUAL CONFOUNDING always limits observational studies, which are best read as attempts to emulate the randomised trial that was not done. Built on the Cochrane risk-of-bias tool (Higgins 2011), the allocation-concealment and blinding assessment (Schulz 2001), the allocation-subversion case study (Kennedy 2017), the intention-to-treat versus per-protocol account (Tripepi 2020), the trim-and-fill funnel method (Duval 2000), the funnel-plot education review (Afonso 2024), the mediation-analysis review (Richiardi 2013), the propensity-score author guide (Andrew 2023), the target-trial emulation framework (Hernán 2016), and the CONSORT 2010 reporting guideline (Schulz 2010).
Practise this topic
On this page
Study tools
Your progress
Saved on this device.
Target exams
Red flags
- BIAS is a SYSTEMATIC error that distorts findings in a particular direction. RANDOM error (chance) is unsystematic. Flaws in design, conduct, analysis, or reporting can make an intervention look better or worse than it is.
- A CONFOUNDER is a third variable associated with BOTH the exposure AND the outcome, but NOT on the causal pathway between them. If it lies on the causal pathway it is a MEDIATOR, not a confounder.
- RANDOMISATION is the ONLY method that controls for BOTH known and UNKNOWN confounders. Restriction, matching, stratification, regression and propensity scoring adjust only for measured confounders and carry assumptions and limitations.
- INTENTION-TO-TREAT analysis assesses the effect of ASSIGNING a treatment; PER-PROTOCOL analysis assesses the effect of RECEIVING it as specified. Both are valid with different scopes. Blinding handles PERFORMANCE and DETECTION bias. Allocation concealment handles SELECTION bias.
- PUBLICATION BIAS is a systematic deviation from the truth because published studies are more likely to be included in meta-analyses. Funnel-plot asymmetry screens for it but visual inspection is unreliable — report the RISK of publication bias. Prospective trial registration and CONSORT reporting are the best defence.
- CONFOUNDING is a nuisance to be ELIMINATED. EFFECT MODIFICATION is a real biological INTERACTION to be REPORTED (stratified and presented, not adjusted away) — a drug working in one sex but not the other is effect modification.
Meet the scenario
A registry analysis reports that an intervention improves survival, and a colleague wants to change practice tomorrow. Before you do, you must ask the two questions at the heart of critical appraisal: is the survival difference real, or is it an artefact of who was selected for the intervention — and has a third variable, like overall fitness, manufactured the benefit? An observational analysis is best read as an attempt to emulate the randomised trial that was not done, and criticised as such. Failing to name either error means adopting an intervention that does not work, or abandoning one that does.[9]
References10ShowHide
- [1]Higgins JP, Altman DG, Gøtzsche PC, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ, 2011.PMID 22008217
- [2]Schulz KF Assessing allocation concealment and blinding in randomised controlled trials: why bother? Evid Based Nurs, 2001.PMID 11707879
- [3]Kennedy ADM, Torgerson DJ, Campbell MK, et al. Subversion of allocation concealment in a randomised controlled trial: a historical case study. Trials, 2017.PMID 28464922
- [4]Tripepi G, Chesnaye NC, Dekker FW, et al. Intention to treat and per protocol analysis in clinical trials. Nephrology (Carlton), 2020.PMID 32147926
- [5]Duval S, Tweedie R Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 2000.PMID 10877304
- [6]Afonso J, Ramirez-Campillo R, Clemente FM, et al. The Perils of Misinterpreting and Misusing "Publication Bias" in Meta-analyses: An Education Review on Funnel Plot-Based Methods. Sports Med, 2024.PMID 37684502
- [7]Richiardi L, Bellocco R, Zugna D Mediation analysis in epidemiology: methods, interpretation and bias. Int J Epidemiol, 2013.PMID 24019424
- [8]Andrew BY, Alan Brookhart M, Pearse R, et al. Propensity score methods in observational research: brief review and guide for authors. Br J Anaesth, 2023.PMID 37481434
- [9]Hernán MA, Robins JM Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available. Am J Epidemiol, 2016.PMID 26994063
- [10]Schulz KF, Altman DG, Moher D, et al. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ, 2010.PMID 20332509