Interpreting systematic reviews and clinical guidelines — formative SAQs

SAQ 1 (10 marks)

You are asked to interpret a meta-analysis claiming a new therapy halves the risk of a serious complication in children. The review was industry-funded, its funnel plot is asymmetric, and its I-squared is 65 percent. ^[10]

1. Outline the steps you would take to appraise this review before applying its pooled result. (4) ^{[1] [2]}
2. Explain what the asymmetric funnel plot and the I-squared of 65 percent each suggest for the pooled estimate. (3) ^{[2] [4]}
3. Describe how you would convey the size of the benefit to the family. (3) ^{[10] [8]}

Model answer

First confirm the question was focused and preregistered, then check that the search was reproducible and exhaustive with a readable PRISMA 2020 flow diagram that reaches trial registers and unpublished data. Score the risk of bias of the review and its included studies with AMSTAR-2 or ROBIS, paying attention to protocol registration, duplicate screening, and the handling of the included studies' own bias. Only then read the pooled effect with its confidence interval, quantifying heterogeneity and checking for publication bias, before weighing applicability to the child and rating the certainty with GRADE. ^{[1] [2] [10]}

The asymmetric funnel plot suggests publication bias — small negative studies failed to reach publication, so the pooled estimate overstates the true effect. The I-squared of 65 percent indicates substantial heterogeneity, meaning the included studies disagree beyond chance, so the pooled estimate is fragile and should be treated cautiously until a clinically sensible subgroup explains the disagreement. The industry funding adds a further structural reason to read the certainty as low. ^{[2] [4]}

To convey the benefit, give the absolute baseline risk and the absolute risk reduction, the number needed to treat, and the confidence interval, so the family understands both the magnitude they can feel and the range compatible with the data. Where the certainty is low and the choice is preference-sensitive, present the uncertainty honestly and let the family share the decision. ^{[10] [8]}