Evidence map›Paper›PMID 38641848›Full record

ArticleTrials2024

A maturity model for the scientific review of clinical trial designs and their informativeness.

S Dolley, T Norman, D McNair, D Hartman

Open access · goldAbstract readLetter
In one paragraph

Article in Trials, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
2.7field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 5 citations in OpenAlex.

  1. Article
  2. Regulatory science for AI-basedJournal of pathology informatics · 2026
    Article
  3. Article
  4. Article
  5. Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 1 country.

S DolleyOpen Global Health, 710 12th St South, Ste 2523, Arlington, VA, 22202, USA. shawn@openglobalhealth.org.ORCID http://orcid.org/0000-0003-1266-1722
T NormanThe Bill & Melinda Gates Foundation, 500 Fifth Ave. North, Seattle, WA, 98109, USA.ORCID http://orcid.org/0000-0003-2707-4387
D McNairThe Bill & Melinda Gates Foundation, 500 Fifth Ave. North, Seattle, WA, 98109, USA.
D HartmanThe Bill & Melinda Gates Foundation, 500 Fifth Ave. North, Seattle, WA, 98109, USA.
Gates Foundation · USOpen Geospatial Consortium · US

Funding

Bill and Melinda Gates Foundation INV-046568
6 · The paper itself

Abstract

backgroundInformativeness, in the context of clinical trials, defines whether a study's results definitively answer its research questions with meaningful next steps. Many clinical trials end uninformatively. Clinical trial protocols are required to go through reviews in regulatory and ethical domains: areas that focus on specifics outside of trial design, biostatistics, and research methods. Private foundations and government funders rarely require focused scientific design reviews for these areas. There are no documented standards and processes, or even best practices, toward a capability for funders to perform scientific design reviews after their peer review process prior to a funding commitment. MAIN BODY: Considering the investment in and standardization of ethical and regulatory reviews, and the prevalence of studies never finishing or failing to provide definitive results, it may be that scientific reviews of trial designs with a focus on informativeness offer the best chance for improved outcomes and return-on-investment in clinical trials. A maturity model is a helpful tool for knowledge transfer to help grow capabilities in a new area or for those looking to perform a self-assessment in an existing area. Such a model is offered for scientific design reviews of clinical trial protocols. This maturity model includes 11 process areas and 5 maturity levels. Each of the 55 process area levels is populated with descriptions on a continuum toward an optimal state to improve trial protocols in the areas of risk of failure or uninformativeness.

conclusionThis tool allows for prescriptive guidance on next investments to improve attributes of post-funding reviews of trials, with a focus on informativeness. Traditional pre-funding peer review has limited capacity for trial design review, especially for detailed biostatistical and methodological review. Select non-industry funders have begun to explore or invest in post-funding review programs of grantee protocols, based on exemplars of such programs. Funders with a desire to meet fiduciary responsibilities and mission goals can use the described model to enhance efforts supporting trial participant commitment and faster cures.

Indexed as

Research DesignClinical Trials as TopicHumansClinical trialDesign reviewInformativenessMaturity modelTrial methods

Identifiers

PMID38641848
PMCPMC11027356
OpenAlexW4394951482

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.