O&G SAQs · Professional practice
Evidence-based medicine — structured SAQ (15 marks)
FRANZCOG-format structured SAQ on evidence-based medicine and statistics: PICO question formulation, hierarchy and appraisal, calculation of ARR and NNT, interpretation of funnel plot and I² under GRADE, and application of evidence through shared decision-making. Per-sub-part marking rubric included.
On this page & tools
Target exams
How this SAQ is marked
Twelve SAQs, 180 marks, two 2-hour papers — roughly 15 marks and 20 minutes each. Marks come from specifics: named designs, named appraisal tools, exact calculations, named thresholds, named GRADE domains. Write in short labelled points, not prose paragraphs. Answer the sub-part you are asked.[7]
Reveal model answer and mark scheme
(a) The well-built PICO question (2 marks)
One mark for naming each of P, I and C; one mark for O. Full marks require specificity. [1]
- Population — pregnant women at less than 28 weeks without prior preterm birth, no comorbidities (the patient), or if you are framing a broader question — pregnant women without prior spontaneous preterm birth.
- Intervention — the specific probiotic preparation the patient is asking about (name the strain or formulation).
- Comparator — placebo or no probiotic.
- Outcome — preterm birth under 37 weeks (and secondarily, neonatal morbidity, maternal satisfaction, side effects, cost).[1]
(b) Hierarchy of evidence, most appropriate design, and appraisal tool (3 marks)
One mark per element. [2][3][7]
- Hierarchy — top of the hierarchy for therapy: systematic review and meta-analysis of randomised controlled trials; second-best is a single well-conducted randomised trial. Filtered sources (Cochrane, RANZCOG, RCOG, NICE) come before a PubMed search.[7]
- Most appropriate design — randomised controlled trial (RCT) of the probiotic versus placebo, ideally synthesised in a systematic review and meta-analysis.[7]
- Appraisal tool — PRISMA 2020 for reporting of the systematic review; AMSTAR 2 for the methodological quality of the review; RoB 2 for the risk of bias within the individual RCTs; CONSORT 2010 for trial reporting.[2][3][7]
(c) Calculate ARR and NNT (3 marks)
One mark for the calculation, one mark for the answer, one mark for interpreting in context. [7]
- RR = 0.78, baseline 8% → risk in probiotic arm = 0.08 × 0.78 = 0.0624 (6.24%).
- ARR = 0.08 − 0.0624 = 0.0176, that is, 1.76 percentage points.
- NNT = 1 / ARR = 1 / 0.0176 ≈ 56.8, that is, NNT ≈ 57.
- Interpretation: the probiotic prevents one preterm birth per approximately 57 women treated. State RR, ARR and NNT together; do not quote RRR (1 − 0.78 = 22%) without the absolute baseline.[7]
(d) Funnel plot and I² under GRADE (3 marks)
One mark per meaningful interpretation. [4][5][6]
- Funnel plot asymmetry suggests possible publication bias — small negative trials missing from the literature. Under GRADE this is a reason to downgrade for publication bias.[4][5]
- I² of 12% indicates low statistical heterogeneity — variation across trials is mostly chance, not real differences between populations or interventions. This is reassuring; under GRADE it does not trigger a downgrade for inconsistency.[4][6]
- Overall GRADE — starts at high (RCT evidence) and is likely downgraded once for publication bias to moderate certainty. Check also risk of bias in individual trials (RoB 2) and indirectness if your patient differs from trial populations.[4]
(e) Integrate evidence with patient values (4 marks)
One mark per substantive point; show the structure of shared decision-making, not just the conclusion. [7][8]
- Applicability check — confirm whether the trial population matches your patient (risk status, gestational age, formulation, duration, baseline risk). The trial's baseline rate (8%) is closer to a higher-risk population; the absolute benefit in a low-risk woman (5–6% baseline) is correspondingly smaller and the NNT would be higher.[7]
- GRADE recommendation direction — likely a strong recommendation in favour for higher-risk women, weak/conditional recommendation for low-risk women like yours where the absolute benefit is smaller and values/preferences matter.[4]
- Share the decision — present the evidence in plain language: the relative reduction (~22%), the absolute benefit (around 1–2 per 100), the NNT (~50–100 for a low-risk woman), uncertainty around long-term outcomes and any side effects, cost and burden. Ask what matters to her — safety, doing something proactive, avoiding interventions, cost.[7]
- Document and review — record the PICO, the evidence considered, the GRADE certainty, the recommendation direction, the patient's informed preference and a review date. Audit whether outcomes in your service match the trial.[4][7]
You have read the opening of this SAQ. The complete unit — every section and its primary-source references — is part of the Obstetrics & Gynaecology fellowship atlas.
References8Show ledgerHide ledger
- [1]Richardson WS, Wilson MC, Nishikawa J, et al. The well-built clinical question: a key to evidence-based decisions ACP J Club, 1995.PMID 7582737
- [2]Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews BMJ, 2021.PMID 33782057
- [3]Sterne JAC, Savović J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials BMJ, 2019.PMID 31462531
- [4]Balshem H, Helfand M, Schünemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence J Clin Epidemiol, 2011.PMID 21208779
- [5]Egger M, Davey Smith G, Schneider M, et al. Bias in meta-analysis detected by a simple, graphical test BMJ, 1997.PMID 9310563
- [6]Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses BMJ, 2003.PMID 12958120
- [7]Murad MH, Montori VM, Ioannidis JP, et al. How to read a systematic review and meta-analysis and apply the results to patient care: users' guides to the medical literature JAMA, 2014.PMID 25005654
- [8]Ioannidis JP Why most published research findings are false PLoS Med, 2005.PMID 16060722