Draft monograph: Mazdutide — submissions
The 9 submissions received, published in full with declared interests and secretariat responses.
§2Submissions and responses
9 submissions were received. Each is published in full below with its declared interest, the secretariat response and the disposition. The Institute publishes submissions it did not accept in the same form as those it did.
Trials are described as terminated where they completed as planned
This submission addresses the draft monograph on Mazdutide. The respondent went through the document twice, once as a specialist and once as a reader arriving without the background.
The respondent states that the draft uses the word terminated for trials stopped at pre-specified interim analyses, for trials stopped for futility and for trials closed for commercial reasons, and that these are three different facts.
The respondent proposes that the status vocabulary be fixed and defined in the glossary.
The secretariat accepts this submission in part. The vocabulary is fixed and defined. The proposal to distinguish commercial closure from futility in every case is accepted only where the Institute holds a document stating the reason.
Trial status now uses a fixed vocabulary defined in the glossary, and where the reason for stopping is not evidenced by a document the Institute holds, the status is recorded as stopped with the reason not established rather than assigned.
Point estimates are given without an interval
The respondent submits on the draft monograph for Mazdutide. The observation arises from teaching the material rather than from prescribing it.
Several estimates in the draft appear as single figures. The respondent states that a point estimate without an interval invites a precision the underlying data do not support, and that the effect is worst where the estimate is drawn from a small contributing set.
The respondent proposes that no point estimate appear anywhere in the document set without its interval, including in summary tables and in the abstract.
The secretariat accepts this submission in part. Intervals are added wherever the source reports one. The proposal is declined for figures the source published without an interval, because the Institute will not compute an interval a source did not report.
Every estimate now carries its interval where the source reported one, and where it did not, the estimate is annotated as reported without an interval rather than left to appear as a precise figure.
The monograph does not tell a reader that a stated mass may be substantially counter-ion and water
The draft on Mazdutide was read in full. The respondent notes at the outset that this class has an unusually deep randomised evidence base, and that a monograph on it is fairly judged against a higher standard than one on a compound with none.
The draft quotes vial contents in milligrams without stating whether the figure refers to peptide content or to total solids. For an acetate or trifluoroacetate salt of a peptide, the difference between the two can exceed a fifth of the stated mass.
The respondent, an analytical chemist, states that this is the single most consequential misreading in the field and that a monograph that does not address it directly is leaving the reader to discover it.
The secretariat accepts this submission. Moderate certainty evidence from published analytical surveys suggests that content and total solids are routinely conflated in supply documentation, and the draft did not warn the reader.
The monograph now states, at the point where vial contents are first mentioned, that a mass figure is uninterpretable unless it states whether it is peptide content or total solids, and cross-references the content standard in the analytical series.
Anti-drug antibody data are omitted
The draft on Mazdutide is a substantial document and the respondent has confined this submission to one matter.
The respondent states that immunogenicity is measured in the development programmes of peptide therapeutics and that the monograph does not report it, leaving a reader unable to judge whether loss of effect over time has an immunological explanation.
The respondent proposes that anti-drug antibody incidence and its relation to effect be reported for every compound in the series.
The secretariat accepts this submission in part. Immunogenicity is reported where a contributing trial reported it. The proposal to report it for every compound is declined because for many compounds in the series no such data exist and a uniformly empty row is not informative.
Anti-drug antibody incidence and any reported association with loss of effect are now reported where measured, and recorded as not measured where the contributing trials did not assess them.
The monograph should not describe how the compound is supplied outside a regulated route
Having reviewed the draft on Mazdutide, the respondent makes a single submission, on the view that one point put clearly is more use to the secretariat than six put together.
The respondent states that describing presentations observed in unregulated supply risks being read as a guide to obtaining them, and asks that the material be removed.
The respondent accepts that the information is accurate and objects to its presence rather than to its content.
The secretariat notes this submission and records the concern as a real one that the draft had already considered.
No amendment arises. The monograph describes what is supplied and names no supplier, price or route of acquisition, and it carries the standing statement that the Institute assesses evidence and does not recommend use. Describing a presentation a reader may already hold is the condition of being useful to that reader.
The route of administration studied is not the route in which the compound is supplied
The respondent has read Mazdutide and submits on a matter of presentation.
The clinical section describes findings obtained by one route and the supply section describes presentations intended for another. A reader moving between the two sections will carry the effect estimate across the change without noticing that it has been carried, because nothing on the page marks the transition.
The respondent proposes that where the studied route and the supplied presentation differ, the difference be stated in the assessed-outcome table itself rather than in the supply section, on the ground that a reader consults the outcome table and does not always reach §8.
This submission is made in the same spirit as submission 003 and on a different aspect of the draft.
The secretariat accepts this submission. The route by which an estimate was generated is a condition of the estimate and belongs beside it.
The assessed-outcome table now carries the studied route in every row, and a standing note appears wherever the supplied presentation differs from it.
Evidence for one member of the class is presented as evidence for this compound
This is a submission on the draft covering Mazdutide, from a respondent whose work is with the people taking compounds of this class rather than with the trials that produced them.
The draft supports a statement about this compound with a citation to a trial of a different compound in the same class. The respondent states that a class-level inference is a judgement that should be labelled as one rather than presented as direct evidence.
The respondent proposes that any class-level extrapolation be flagged at the point of use and excluded from the certainty rating for the compound itself.
The secretariat accepts this submission. Moderate certainty evidence supports several class-level statements in this area, but a class-level statement is not evidence about a particular member of the class.
Class-level inferences are now labelled at the point of use, are excluded from the certainty rating for the compound, and are reported in a separate subsection stating which compound the underlying evidence concerns.
The certainty rating for the principal assessed outcome cannot be traced to the contributing trials
The respondent read the draft on Mazdutide alongside the approved labelling for the class, and submits on one matter arising.
The draft states a certainty rating for the principal assessed outcome and lists the contributing trials, but does not state which domain drove the downgrade. A reader who disagrees with the rating cannot tell whether the disagreement concerns risk of bias, imprecision, indirectness or inconsistency.
The respondent proposes that each rating carry its downgrade reasons explicitly, in the same row as the rating, so that a reader can accept the evidence assessment while disputing a single domain judgement.
The secretariat accepts this submission. A rating without its reasoning is an assertion, and the draft asserted rather than showed.
Each assessed outcome now carries its downgrade domains in the summary-of-findings row, with a short statement of the judgement made in each, so that the rating can be checked domain by domain against the contributing trials.
The indication table mixes approved indications with uses for which the compound is merely supplied
The respondent has read the draft monograph on Mazdutide against a caseload in which incretin analogues are prescribed daily.
The indication table lists indications in a single sequence. Some are approved by a competent authority, some are the subject of trials that have not reported, and some are uses observed in supply with no trial evidence at all.
The respondent states that the three categories should not share a table without being distinguished in it.
Submission 005 concerns the same document. The respondent’s point is a different one.
The secretariat accepts this submission. A shared table is an implicit claim of comparable standing.
The indication table now carries a status column with three values, approved, under investigation and supplied without trial evidence, and the value is stated for every row. Rows in the third category also state that no certainty rating is assigned because there is no evidence base to rate.
References cited on this page
References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.
- International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute
Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.