Evidence map›Paper›PMID 32908284›Full record

GuidelineNature medicine2020

Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension.

Samantha Cruz Rivera, Xiaoxuan Liu, An-Wen Chan, Alastair K Denniston, Melanie J Calvert, SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, SPIRIT-AI and CONSORT-AI Consensus Group

2 registry-linked trialsAbstract readGuidelineReview
In one paragraph

Guideline in Nature medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 379 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
379citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06792890 nacompletednot on this mapstarted 2024, after this paper: background citation

A Randomized Controlled Trial of Two Ambient Artificial Intelligence Scribe Technologies to Improve Documentation Efficiency and Reduce Physician Burnout

TypeinterventionalSponsorUniversity of California, Los AngelesRan2024 to 2025Enrolled238ConditionsPhysician Workflow, Artificial Intelligence (AI)ArmsUse Nabla AI Scribe tool provided, Use AI Scribe tool provided by Vendor B
NCT07179861 completednot on this mapstarted 2025, after this paper: background citation

A Prospective, Cross-Sectional, Vignette-Based Observational Study Comparing Clinical Decision-Making Performance of Pediatriciansand AI Models

TypeobservationalSponsorHaseki Training and Research HospitalRan2025 to 2025Enrolled30ConditionsArtificial Intelligence (AI) in Diagnosis, Decision Support Systems, Clinical, Clinical Decision-making, PediatricsArmsAI Suggestions (Anonymized 5-tool panel), Confidence Rating Task (1-10 Likert)
3 · Its place in the literature

Who cites it

379 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Observational
  8. Article
  9. Review
  10. Review
  11. AI In Leukemia Diagnostics: Complementing the Pathologist's Role.International journal of laboratory hematology · 2026
    Review
  12. Article
  13. Review
  14. Review
  15. Article
  16. Article
  17. Review
  18. Review
  19. Review
  20. Review

319 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Samantha Cruz RiveraCentre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK.
Xiaoxuan LiuBirmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK.ORCID http://orcid.org/0000-0002-1286-0038
An-Wen ChanDepartment of Medicine, Women's College Research Institute, Women's College Hospital, University of Toronto, Ontario, Canada.
Alastair K DennistonCentre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK. a.denniston@bham.ac.uk.ORCID http://orcid.org/0000-0001-7849-0087
Melanie J CalvertCentre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK.ORCID http://orcid.org/0000-0002-1856-837X
SPIRIT-AI and CONSORT-AI Working Group
SPIRIT-AI and CONSORT-AI Steering Group
SPIRIT-AI and CONSORT-AI Consensus Group

Funding

Epidemiology and clinical outcomes of diabetic macular edemaK23EY029246 · NEI · UNIVERSITY OF WASHINGTON · PI LEE, AARON · 2018 to 2022
$1.1M
Predicting Pulmonary and Cardiac Morbidity in Preterm Infants with Deep LearningK01HL141771 · NHLBI · HARVARD SCHOOL OF PUBLIC HEALTH · PI BEAM, ANDREW L. · 2019 to 2023
$832k
Cancer Research UK 16895Cancer Research UK 27294Department of HealthMedical Research Council MC_PC_19005Medical Research Council MR/T019050/1NEI NIH HHS K23 EY029246NHLBI NIH HHS K01 HL141771Wellcome Trust
6 · The paper itself

Abstract

The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.

Indexed as

Artificial IntelligenceClinical Trials as TopicHumansResearch Design

Identifiers

PMID32908284
PMCPMC7598944

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.