SynthesisNature communications2024
Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines.
Synthesis in Nature communications, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 28 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
28 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Concordance with SPIRIT-AI guidelines in reporting of randomized controlled trial protocols investigating artificial intelligence in oncology: a systematic review.The oncologist · 2025Pooled it
- Artificial Intelligence in Healthcare Practice: Validation, Fairness, and Regulatory Challenges: A Systematic Review.Inquiry : a journal of medical care organization, provision and financingPooled it
- Machine learning and AI for cancer research and care: a review of applications, limitations, and future directions.Journal of the Egyptian National Cancer Institute · 2026Review
- Artificial intelligence in cardiovascular care: a systematic review and meta-analysis of randomised controlled trials.EClinicalMedicine · 2026Article
- Clinical outcomes and reporting quality of large language model interventions in practice: a systematic evidence map.NPJ digital medicine · 2026Article
- Artificial Intelligence in Gastrointestinal Endoscopy and Hemostatic Decision-Making: Current Evidence, Clinical Implications and Implementation Barriers.Life (Basel, Switzerland) · 2026Review
- A quantitative analysis of global AI medical studies: gaps in randomized controlled trials.NPJ digital medicine · 2026Article
- Are AI Neuroimaging Models Ready for Clinical Use? A Systematic Methodological Review.Journal of clinical medicine · 2026Review
- A literature review and reflection on clinical trials: current challenges, future directions, and potential strategies to overcome practical barriers.AME clinical trials review · 2026Article
- Artificial intelligence in cardiology: a narrative review with focus on patient outcomes.Cardiovascular diagnosis and therapy · 2026Review
- Toward integrated sleep health: multimodal AI in Hang Hao Meng agent.NPJ digital medicine · 2026Review
- AI-enabled passive digital phenotyping of experiential negative symptoms in schizophrenia-spectrum disorders: a narrative review on the path from sensing to clinical endpoints.Frontiers in psychiatry · 2026Review
- Applications of artificial intelligence in non-small cell lung cancer: from precision diagnosis to personalized prognosis and therapy.Journal of translational medicine · 2025Review
- An assessment of the informativeness of clinical trials in digital mental health.Npj mental health research · 2025Article
- Article
- The future is now: How AI is reshaping spine care.North American Spine Society journal · 2025Article
- Toward governance of artificial intelligence in pediatric healthcare.NPJ digital medicine · 2025Review
- Evaluation and Regulation of Artificial Intelligence Medical Devices for Clinical Decision Support.Annual review of biomedical data science · 2025Review
- Around the EQUATOR With Clin-STAR: AI-Based Randomized Controlled Trial Challenges and Opportunities in Aging Research.Journal of the American Geriatrics Society · 2025Article
- The role of artificial intelligence in cardiovascular research: Fear less and live bolder.European journal of clinical investigation · 2025Review
Corrections and comments
- Erratum issued
Authors and funding
22 authors.
Funding
Abstract
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77-94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.