Independent · non-commercial · publishes on a quarterly cycle|Current cycle 2026 Q3
Compound Evidence InstituteEvidence synthesis · established 2023Graded assessments of compounds, trials, methods and supply
Document set current to 30 July 2026
Public comment period · §3

Draft synthesis: Cardiovascular benefit in primary compared… — disposition

The disposition of every submission and the amendments that resulted.

Document identifier
CEI-CP-117/3
Series
Public comment period
Version
1.0
Published
19 Jun 2024
Last reviewed
19 Jun 2024
Next review
19 Jun 2025
Identifier
10.71829/cei.cp.117
Certainty
Not rated
Cycle
2024 Q2
Window
11 May 2024 – 08 Jun 2024
Status
Closed
Submissions
10

§3Disposition and amendments

§3.1Disposition table

Table 1. Every submission with its disposition. Each row links to the submission in full.

ReferenceRespondentPoint raisedDisposition
DRAFT-PRIMARY-VS-S/001Dr Oisín RautavaaraA single-trial result is presented in the visual form of a pooled estimateAccepted
DRAFT-PRIMARY-VS-S/002Dr Jerome PetrossianAn indirect comparison is presented without an assessment of transitivityAccepted
DRAFT-PRIMARY-VS-S/003Dr Yaa KettlewellThe axis of the forest plot exaggerates a small differenceAccepted in part
DRAFT-PRIMARY-VS-S/004Dr Adaeze Underhill-OkaforTwo included studies do not meet the registered eligibility criteriaAccepted in part
DRAFT-PRIMARY-VS-S/005Dr Melisande Kirkpatrick-OlaResults at materially different follow-up durations are pooledAccepted
DRAFT-PRIMARY-VS-S/006Dr Lorcan Zaleski-MbekiEfficacy outcomes are rated for certainty and harms are notAccepted
DRAFT-PRIMARY-VS-S/007Eamon Sandringham-AduThe search date is not on the face of the documentAccepted
DRAFT-PRIMARY-VS-S/008Dr Kolawole Isaksen-BalogunStatistical heterogeneity is treated as though it measured clinical heterogeneityAccepted in part
DRAFT-PRIMARY-VS-S/009Thaddeus Isaksen-BalogunOverlapping primary studies across included reviews are counted more than onceAccepted
DRAFT-PRIMARY-VS-S/010Anselm MountstephenThe search strategy as published cannot be re-runAccepted
10 submissions in total.

§3.2Summary by disposition

Table 2. Counts by disposition, with the meaning of each.

DispositionCountMeaning
Accepted7The submission is accepted and the draft is amended as proposed. The amendment is recorded in the amendment log of the document it changed and is traceable to the numbered submission.
Accepted in part3Part of the submission is accepted and part is not. The secretariat response states which part is which and on what ground the remainder was declined.
Noted, no amendment0The submission raises a point the Institute accepts but that does not require a change to the draft, most often because the draft already states it elsewhere. The location is given in the response.
Not accepted0The submission is not accepted. The secretariat response gives the reason. A submission that is not accepted remains published in full; the Institute does not remove a submission because it disagrees with it.

§3.3Resulting amendments

  1. A single-trial result is presented in the visual form of a pooled estimate — arising from DRAFT-PRIMARY-VS-S/001. Outcomes contributed by a single trial are now reported without a pooled diamond, labelled as unreplicated, and downgraded for imprecision or inconsistency according to the framework rather than presented as a synthesis.
  2. An indirect comparison is presented without an assessment of transitivity — arising from DRAFT-PRIMARY-VS-S/002. Transitivity is now assessed against a stated list of effect modifiers and reported before any indirect estimate, and where the assessment fails the contrast is reported as unestimable with the reason rather than estimated with a caveat.
  3. The axis of the forest plot exaggerates a small difference — arising from DRAFT-PRIMARY-VS-S/003. Forest plots now carry a marked minimally important difference wherever a published one exists for the outcome, with its source cited. Where none exists the figure says so beneath the axis.
  4. Two included studies do not meet the registered eligibility criteria — arising from DRAFT-PRIMARY-VS-S/004. One study has been removed from the included set and the estimate recomputed, the exclusion reason for the third study has been corrected in the excluded-studies table, and the screening decisions are now recorded against the protocol version in force at the…
  5. Results at materially different follow-up durations are pooled — arising from DRAFT-PRIMARY-VS-S/005. Estimates are now reported by duration band, with the number of contributing trials and participants in each band stated, and no estimate is pooled across bands.
  6. Efficacy outcomes are rated for certainty and harms are not — arising from DRAFT-PRIMARY-VS-S/006. Every reported harm now carries a certainty rating on the same scale as the efficacy outcomes, with the downgrade reasons stated, and discontinuation for adverse events appears in the summary of findings rather than in an annex.
  7. The search date is not on the face of the document — arising from DRAFT-PRIMARY-VS-S/007. The search date is now printed adjacent to every certainty rating and is carried in the document metadata, so that the interval between the search and the reading is visible without reference to the methods section.
  8. Statistical heterogeneity is treated as though it measured clinical heterogeneity — arising from DRAFT-PRIMARY-VS-S/008. The decision to pool is now justified in prose against the population, intervention, comparator and outcome before any statistic is presented, and the heterogeneity statistic is reported with its confidence interval and a note of the number of contributing…
  9. Overlapping primary studies across included reviews are counted more than once — arising from DRAFT-PRIMARY-VS-S/009. Overlap between included reviews is now assessed at primary-study level and reported in a citation matrix, and participant totals are reported for the union of primary studies rather than as a sum across reviews.
  10. The search strategy as published cannot be re-run — arising from DRAFT-PRIMARY-VS-S/010. The full line-by-line strategy for each database is now published with the interface, the run date and the yield at each line, and the total retrieved is reconciled against the screening flow.

References cited on this page

References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.

  1. International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute

Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.

Nothing published by the Institute is medical advice, a diagnosis, a prescription, a treatment recommendation or a purchasing recommendation. Compounds supplied for research use are not approved for human or veterinary use in any jurisdiction, and a favourable analytical assessment of a supplier is not a statement that any product is safe or effective. The Institute publishes certainty ratings and never recommendations. No telephone number, messaging handle or ordering channel appears anywhere on this site.