Skip to main content
MedVellum
QuestionsVideosPricing

MedVellum

Fellowship exam preparation across every specialty: source-verified topics, questions in every format, and videos.

Product

  • Specialties
  • Questions
  • Videos
  • Exam tools
  • Pricing

Verification & policy

  • Verified register
  • Editorial policy
  • Privacy
  • Terms

Account

  • Sign in
  • Create account
  • Dashboard
  • Account & billing

© 2026 MedVellum. For education only — not a substitute for clinical judgement.

llms.txtPsychiatry LLM catalogSitemap

Anaes TopicsMeasurement & monitoring physics

Anaes · Measurement & monitoring physics

Study design and the hierarchy of evidence

Also known as Hierarchy of evidence · Study design · Evidence-based anaesthesia · Critical appraisal · GRADE · Randomised controlled trials · Systematic reviews · Meta-analysis

Every anaesthetic decision — which induction agent, which airway device, which perioperative bundle — should be anchored in the best available evidence, and the framework that ranks that evidence is the hierarchy of study design. The model rests on six exam-critical ideas. First, the HIERARCHY OF EVIDENCE PYRAMID ranks designs from weakest to strongest: expert opinion and anecdote at the base, then case reports and case series, then case-control studies, then cohort studies, then randomised controlled trials, and systematic reviews with meta-analyses at the apex. Second, a CASE-CONTROL study is RETROSPECTIVE — it starts with the outcome and looks back for exposure — and reports an ODDS RATIO, making it efficient for rare diseases but carrying a high risk of bias. Third, a COHORT study is PROSPECTIVE — it starts with the exposure and follows forward for the outcome — and reports a RELATIVE RISK, with incidence, temporality, dropouts, and confounding as its profile. Fourth, a CROSS-SECTIONAL study takes a single SNAPSHOT, reports PREVALENCE, and cannot establish causality. Fifth, the RANDOMISED CONTROLLED TRIAL is the gold standard for therapy because RANDOMISATION distributes confounders equally, with allocation concealment, BLINDING, and INTENTION-TO-TREAT analysis protecting validity; the CONSORT statement guides its reporting. Sixth, SYSTEMATIC REVIEWS and META-ANALYSES (PRISMA reporting) pool the evidence for a single estimate, with heterogeneity, forest and funnel plots, and the GRADE framework rating quality as high, moderate, low or very low. Critical appraisal of an RCT uses the PICO framework. Built on the observational-design primer (Ramji 2022), the case-series appraisal introduction (Munn 2020), the cross-sectional account (Kesmodel 2018), the allocation-subversion case study (Kennedy 2017), the allocation-concealment and blinding assessment (Schulz 2001), the CONSORT 2010 guideline (Schulz 2010), the intention-to-treat account (Tripepi 2020), the PRISMA 2020 statement (Page 2021), the meta-analysis tutorial (Balduzzi 2019), the I-squared account (Borenstein 2017), the frailty-delirium meta-analysis (Gracie 2021), the ROBINS-I tool (Sterne 2016), the GRADE consensus (Guyatt 2008) and GRADE rating guideline (Balshem 2011), and the research-question guide (Aslam 2010).

high15 referencesUpdated 26 July 202612 min readVerification in progress

Practise this topic

  • 8 MCQs

Your progress

Saved on this device.

Practise this topic8 MCQs with explanations

Target exams

ANZCAFRCAABAEDAICFCAIFCA_SA

Red flags

  • The pyramid order, weakest to strongest: expert opinion, case reports and case series, case-control studies, cohort studies, randomised controlled trials, systematic reviews and meta-analyses.
  • CASE-CONTROL is RETROSPECTIVE (outcome first, look back for exposure) and reports an ODDS RATIO — efficient for rare diseases, with a high risk of bias. COHORT is PROSPECTIVE (exposure first, follow for outcome) and reports a RELATIVE RISK — with incidence, temporality, dropouts, and confounding as its profile.
  • The RCT is the gold standard for THERAPY because randomisation distributes confounders equally between groups. Subverted randomisation produces selection bias that can invalidate the result — centralised allocation keeps it secure.
  • INTENTION-TO-TREAT analysis assesses the effect of ASSIGNING a treatment; PER-PROTOCOL analysis assesses the effect of RECEIVING it as specified. Both are valid with different scopes. Per-protocol analysis does not preserve the randomisation.
  • In a META-ANALYSIS: I-squared is NOT an absolute measure of heterogeneity — report the predicted range of effects. The PRISMA 2020 27-item checklist, abstract checklist, and flow diagrams guide reporting.
  • GRADE rates a BODY of evidence as HIGH, MODERATE, LOW or VERY LOW. Randomised trials begin as high quality, observational studies as low; quality can fall with imprecision, inconsistency, indirectness, and publication bias — and rating quality is separated from making recommendations.
On this page
Study tools

Your progress

Saved on this device.

Practise this topic8 MCQs with explanations

Target exams

ANZCAFRCAABAEDAICFCAIFCA_SA

Red flags

  • The pyramid order, weakest to strongest: expert opinion, case reports and case series, case-control studies, cohort studies, randomised controlled trials, systematic reviews and meta-analyses.
  • CASE-CONTROL is RETROSPECTIVE (outcome first, look back for exposure) and reports an ODDS RATIO — efficient for rare diseases, with a high risk of bias. COHORT is PROSPECTIVE (exposure first, follow for outcome) and reports a RELATIVE RISK — with incidence, temporality, dropouts, and confounding as its profile.
  • The RCT is the gold standard for THERAPY because randomisation distributes confounders equally between groups. Subverted randomisation produces selection bias that can invalidate the result — centralised allocation keeps it secure.
  • INTENTION-TO-TREAT analysis assesses the effect of ASSIGNING a treatment; PER-PROTOCOL analysis assesses the effect of RECEIVING it as specified. Both are valid with different scopes. Per-protocol analysis does not preserve the randomisation.
  • In a META-ANALYSIS: I-squared is NOT an absolute measure of heterogeneity — report the predicted range of effects. The PRISMA 2020 27-item checklist, abstract checklist, and flow diagrams guide reporting.
  • GRADE rates a BODY of evidence as HIGH, MODERATE, LOW or VERY LOW. Randomised trials begin as high quality, observational studies as low; quality can fall with imprecision, inconsistency, indirectness, and publication bias — and rating quality is separated from making recommendations.
The one-line answer

The hierarchy of evidence ranks study designs from weakest to strongest: expert opinion at the base, case reports, case-control, cohort, RCT, and systematic reviews with meta-analysis at the apex. The design you choose depends on the question — therapy wants an RCT, a rare adverse effect wants a case-control, prevalence wants a cross-sectional. The RCT is gold standard because randomisation distributes confounders equally; intention-to-treat assesses assignment while per-protocol assesses receipt. GRADE rates a body of evidence as high, moderate, low or very low.[1][7][14]

Meet the patient

An 82-year-old with a femoral neck fracture. The surgeon asks: does regional anaesthesia reduce 30-day mortality compared with general? You have a meta-analysis of several trials, a recent propensity-matched cohort, and your own clinical experience. Which should guide your decision?[1]

The hierarchy of evidence is the tool that answers that question — but it is not a simple "higher is better". The best design is the one that fits the question, and the apex is only as trustworthy as the trials beneath it. Everyone forgets: a meta-analysis of flawed RCTs is a precise but wrong answer.[9]

Anaesthesia Pro

Continue reading

You have read the opening of this topic. The complete unit — every section and its primary-source references — is part of the Anaesthesia fellowship library.

Sign in to continueSee pricing
References15ShowHide
  1. [1]Ramji S Study Design: Observational Studies. Indian Pediatr, 2022.PMID 35481482
  2. [2]Munn Z, Barker TH, Moola S, et al. Methodological quality of case series studies: an introduction to the JBI critical appraisal tool. JBI Evid Synth, 2020.PMID 33038125
  3. [3]Kesmodel US Cross-sectional studies - what are they good for? Acta Obstet Gynecol Scand, 2018.PMID 29453895
  4. [4]Kennedy ADM, Torgerson DJ, Campbell MK, et al. Subversion of allocation concealment in a randomised controlled trial: a historical case study. Trials, 2017.PMID 28464922
  5. [5]Schulz KF Assessing allocation concealment and blinding in randomised controlled trials: why bother? Evid Based Nurs, 2001.PMID 11707879
  6. [6]Schulz KF, Altman DG, Moher D, et al. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ, 2010.PMID 20332509
  7. [7]Tripepi G, Chesnaye NC, Dekker FW, et al. Intention to treat and per protocol analysis in clinical trials. Nephrology (Carlton), 2020.PMID 32147926
  8. [8]Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 2021.PMID 33782057
  9. [9]Balduzzi S, Rücker G, Schwarzer G, et al. How to perform a meta-analysis with R: a practical tutorial. Evid Based Ment Health, 2019.PMID 31563865
  10. [10]Borenstein M, Higgins JP, Hedges LV, et al. Basics of meta-analysis: I(2) is not an absolute measure of heterogeneity. Res Synth Methods, 2017.PMID 28058794
  11. [11]Gracie TJ, Caufield-Noll C, Wang NY, et al. The Association of Preoperative Frailty and Postoperative Delirium: A Meta-analysis. Anesth Analg, 2021.PMID 34257192
  12. [12]Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ, 2016.PMID 27733354
  13. [13]Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ, 2008.PMID 18436948
  14. [14]Balshem H, Helfand M, Schünemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol, 2011.PMID 21208779
  15. [15]Aslam S, Emmanuel P Formulating a researchable question: A critical step for facilitating good clinical research. Indian J Sex Transm Dis AIDS, 2010.PMID 21808439

Test yourself

Practise what you just read

  • 8 MCQs
Anaesthesia Pro

$29/ monthor $279 / year

The complete Anaesthesia library, every exam format, one subscription.

  • Complete library for one chosen specialty
  • Timed MCQ mock exams and spaced review
  • Clinical cases & cross-table vivas
See pricingSign in
PreviousSI units, dimensions and measurement in anaesthesiaMeasurement & monitoring physicsNextThe gas lawsMeasurement & monitoring physics