Pharmacy & Therapeutics Committee · Formulary review · Draft systematic review submitted as context document
No directional comparative-effectiveness claim is supportable. Within-modality durability claims: Probable.
Finding is the confidence grade itself. Confidence grade is the finding. For an open research question, the grade — not a numeric score — is the complete result.
The ensemble does not support a directional comparative-effectiveness claim between GLP-1 agonists and bariatric surgery for long-term weight maintenance. Bariatric surgery shows comparable-to-larger and more durable weight loss in long-term observational cohorts, but no large long-term head-to-head randomised trial exists — the comparison rests on indirect evidence across materially different populations. The Contrarian's Strong objection on population non-comparability is unresolved. Within-modality durability claims — that surgical loss persists at 5+ years in cohort data — are Probable. The actionable output: any formulary recommendation must be framed as modality-appropriate for distinct patient populations, not as a head-to-head superiority claim.
Settled ground: Both GLP-1 agonists and bariatric surgery produce clinically significant weight loss in the short-to-medium term. Bariatric surgery has long-term (10–20 year) observational durability data. Weight regain follows GLP-1 discontinuation.
Contested terrain: Relative durability of the two modalities beyond three years. Whether the magnitude gap narrows with newer dual agonists. Comparative effectiveness in matched populations.
Unknown territory: No large long-term head-to-head randomised trial has ever compared the two interventions for weight maintenance. Surgical and pharmacological cohorts differ systematically in baseline BMI, age, and comorbidity.
Knowledge gaps entered: (1) Head-to-head RCT with long follow-up — does not exist. (2) Matched-population comparative cohort controlling for baseline differences — does not exist.
Comparability concern flagged: The comparison rests entirely on indirect evidence — no head-to-head randomisation exists. Surgical and pharmacological cohorts are not exchangeable: baseline BMI, age, and comorbidity profiles differ materially, so any cross-cohort effect estimate is not transportable between populations.
Evidence ceiling: the directional comparative claim is capped at Contested — indirect comparison across non-equivalent populations cannot support a superiority finding. Within-modality durability claims (surgical loss persisting at 5+ years in cohort data) are Probable. No node qualifies for Established given the absence of head-to-head randomised evidence.
@Cartographer — Steelman: The long-term observational evidence for surgical durability is genuinely strong, and the direction of the cohort data is consistent. A clinician reading the literature would reasonably conclude surgery is more durable.
Strong objection [Phase 1]: "No large long-term head-to-head randomised trial exists. The comparison rests on indirect evidence across cohorts with materially different baseline BMI, age, and comorbidity profiles — surgical candidates are systematically higher-BMI and higher-risk. The effect estimate is not transportable between these populations, so a directional superiority claim is unsupported regardless of how consistent the cohort data looks." Resolution condition: A head-to-head randomised trial, or a matched-population cohort controlling for the baseline differences.
The long-term observational evidence for surgical durability is genuinely strong and directionally consistent. A clinician reading the literature would reasonably read surgery as more durable.
"No large long-term head-to-head randomised trial exists. Surgical and pharmacological cohorts differ systematically in baseline BMI, age, and comorbidity — the cross-cohort comparison is not transportable, so a directional superiority claim is unsupported."
A head-to-head randomised trial, or a matched-population cohort controlling for baseline BMI, age, and comorbidity differences
That surgery has longer follow-up is a real feature of the evidence base, and longer-term data is genuinely reassuring on durability.
"The surgical durability evidence extends further largely because the intervention is older. Longer follow-up is not the same as superior durability — the comparison is confounded by evidence age, unacknowledged in the draft."
Explicit acknowledgment of the evidence-age confound in the review's limitations section
Pragmatist action item: Add evidence-age and population-comparability caveats to the review before circulation
No retracted papers. All primary trial citations authenticated against registries. One industry-funded extension study flagged for disclosure. Self-citation ratio within field norms. Phase boundary clearances issued at P1/2 and P2/3.
For open research questions, the confidence grade is the complete finding — calibrated against the evidence base, not against a binary resolution outcome.