Independent · non-commercial · publishes on a quarterly cycle|Current cycle 2026 Q3
Compound Evidence InstituteEvidence synthesis · established 2023Graded assessments of compounds, trials, methods and supply
Document set current to 30 July 2026
Public comment period · §3

Draft terms for the Institute’s calculators — disposition

The disposition of every submission and the amendments that resulted.

Document identifier
CEI-CP-029/3
Series
Public comment period
Version
1.0
Published
01 May 2025
Last reviewed
01 May 2025
Next review
01 May 2026
Identifier
10.71829/cei.cp.29
Certainty
Not rated
Cycle
2025 Q1
Window
07 Feb 2025 – 24 Mar 2025
Status
Closed
Submissions
18

§3Disposition and amendments

§3.1Disposition table

Table 1. Every submission with its disposition. Each row links to the submission in full.

ReferenceRespondentPoint raisedDisposition
DRAFT-TOOLS-DISCLA/001Professor Bartolomeu Nkosi-LindegaardIndependence is asserted and the mechanism securing it is not describedAccepted
DRAFT-TOOLS-DISCLA/002Dr Georgiana MountstephenWhat the site collects about a reader is not stated in terms a reader can checkAccepted
DRAFT-TOOLS-DISCLA/003Eamon Sandringham-AduThe search date is not on the face of the documentAccepted
DRAFT-TOOLS-DISCLA/004Dr Vasilisa Sandringham-AduA party that is assessed and also sponsors should be disclosed on its own assessmentAccepted
DRAFT-TOOLS-DISCLA/005Ivo MountstephenThe terms on which the documents may be reused are not statedAccepted
DRAFT-TOOLS-DISCLA/006Kolawole Oppenheimer-AdeThe Institute publishes no telephone number and no messaging channelNoted, no amendment
DRAFT-TOOLS-DISCLA/007Dr Emiliana OllerenshawFunding should not be accepted from any party the Institute assessesAccepted in part
DRAFT-TOOLS-DISCLA/008Dr Quentin EnthovenNo term limit applies to membership of the assessment committeeAccepted
DRAFT-TOOLS-DISCLA/009Anselm MountstephenA reader who acted on a document is not told when it is correctedAccepted
DRAFT-TOOLS-DISCLA/010Yolanda Norrington-BhattA four-week window is too short for a respondent without institutional supportAccepted in part
DRAFT-TOOLS-DISCLA/011Amara VandergraafA submission the Institute declines to publish leaves no traceNoted, no amendment
DRAFT-TOOLS-DISCLA/012Quentin Whitmarsh-ObiReferences should carry a persistent identifier for every cited sourceAccepted in part
DRAFT-TOOLS-DISCLA/013Dr Evander Ashworth-DanquahThe same concept is given three different names in one documentAccepted
DRAFT-TOOLS-DISCLA/014Dr Beatrijs HazelriggAssessment committee meetings are held in privateNoted, no amendment
DRAFT-TOOLS-DISCLA/015Dr Quentin Gwynne-SarpongWhether external reviewers are paid is not statedAccepted
DRAFT-TOOLS-DISCLA/016Dr Vasilisa ImmelmannThere is no route to challenge a dispositionAccepted
DRAFT-TOOLS-DISCLA/017Dr Constança Glendinning-UcheThe secretariat answers submissions and is not itself namedAccepted in part
DRAFT-TOOLS-DISCLA/018Dr Perpetua Haverkamp-Diallo industryThe disclosure requirements exceed those of comparable bodiesNoted, no amendment
18 submissions in total.

§3.2Summary by disposition

Table 2. Counts by disposition, with the meaning of each.

DispositionCountMeaning
Accepted10The submission is accepted and the draft is amended as proposed. The amendment is recorded in the amendment log of the document it changed and is traceable to the numbered submission.
Accepted in part4Part of the submission is accepted and part is not. The secretariat response states which part is which and on what ground the remainder was declined.
Noted, no amendment4The submission raises a point the Institute accepts but that does not require a change to the draft, most often because the draft already states it elsewhere. The location is given in the response.
Not accepted0The submission is not accepted. The secretariat response gives the reason. A submission that is not accepted remains published in full; the Institute does not remove a submission because it disagrees with it.

§3.3Resulting amendments

  1. Independence is asserted and the mechanism securing it is not described — arising from DRAFT-TOOLS-DISCLA/001. The governance document now describes the separation in operational terms: who accepts funding, who makes assessments, that the two sets do not overlap, and that assessment staff are not informed of placement decisions before publication.
  2. What the site collects about a reader is not stated in terms a reader can check — arising from DRAFT-TOOLS-DISCLA/002. The statement now enumerates what is collected and what is not, and is written so that a reader can verify it from the page source, which is the only form of the statement that can be checked without trusting the Institute.
  3. The search date is not on the face of the document — arising from DRAFT-TOOLS-DISCLA/003. The search date is now printed adjacent to every certainty rating and is carried in the document metadata, so that the interval between the search and the reading is visible without reference to the methods section.
  4. A party that is assessed and also sponsors should be disclosed on its own assessment — arising from DRAFT-TOOLS-DISCLA/004. The disclosure now appears as a numbered section on the dossier of any assessed party that sponsors the site, as well as on the funding page.
  5. The terms on which the documents may be reused are not stated — arising from DRAFT-TOOLS-DISCLA/005. The reuse terms are now stated explicitly on the legal page and in the document footer, permitting quotation and reproduction with attribution and the document version, and requiring that any reproduction carry the certainty rating that accompanied the quoted…
  6. Funding should not be accepted from any party the Institute assesses — arising from DRAFT-TOOLS-DISCLA/007. The policy now prohibits funding from an assessed party for any activity bearing on that party's assessment, requires that any other relationship be published on the funding page and on every page it could bear on, and records the sums involved rather than…
  7. No term limit applies to membership of the assessment committee — arising from DRAFT-TOOLS-DISCLA/008. Members are appointed for a four-year term renewable once. Appointment and expiry dates are published in the register of members.
  8. A reader who acted on a document is not told when it is corrected — arising from DRAFT-TOOLS-DISCLA/009. A corrected passage now carries an inline notice for twelve months from the date of correction, naming the log entry, in addition to the entry itself.
  9. A four-week window is too short for a respondent without institutional support — arising from DRAFT-TOOLS-DISCLA/010. The minimum window is now six weeks for a document of general application and four for a document-specific draft. A respondent who asks for more time before a window closes is given it, and that is now stated in the policy.
  10. References should carry a persistent identifier for every cited source — arising from DRAFT-TOOLS-DISCLA/012. Every reference without a persistent identifier now carries an explicit statement that the identifier is not held by the Institute, so that its absence is a recorded fact rather than an apparent oversight.
  11. The same concept is given three different names in one document — arising from DRAFT-TOOLS-DISCLA/013. A single term is now used throughout for each defined concept, and the glossary entry is linked at first use within each section rather than once per document.
  12. Whether external reviewers are paid is not stated — arising from DRAFT-TOOLS-DISCLA/015. The policy now states whether external review is remunerated, records any payment made in respect of a document in that document's front matter, and treats a payment received from the Institute as a declarable interest in the same way as any other.
  13. There is no route to challenge a disposition — arising from DRAFT-TOOLS-DISCLA/016. A disposition may now be referred for review to a member of the assessment committee who did not author the response, once per submission, with the referral and its outcome published alongside the original disposition whether or not it changes.
  14. The secretariat answers submissions and is not itself named — arising from DRAFT-TOOLS-DISCLA/017. Every comment period now names the secretariat members responsible for it, with their declared interests, in the consultation front matter, so that the responses can be read against the interests of the people who wrote them.

References cited on this page

References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.

  1. International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute

Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.

Nothing published by the Institute is medical advice, a diagnosis, a prescription, a treatment recommendation or a purchasing recommendation. Compounds supplied for research use are not approved for human or veterinary use in any jurisdiction, and a favourable analytical assessment of a supplier is not a statement that any product is safe or effective. The Institute publishes certainty ratings and never recommendations. No telephone number, messaging handle or ordering channel appears anywhere on this site.