Evidence map›Paper›PMID 38605106›Full record

ArticleCommunications medicine2024

Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis.

Fiona R Kolbinger, Gregory P Veldhuizen, Jiefu Zhu, Daniel Truhn, Jakob Nikolas Kather

Abstract read
In one paragraph

Article in Communications medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 73 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
73citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

73 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Guideline
  4. Article
  5. The consensus-based CINEX guideline for reporting clinical information extraction studies.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  6. Article
  7. Article
  8. Review
  9. [Application of hybrid attention guided dual-path residual learning in magnetic resonance imaging diagnosis].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2026
    Article
  10. Review
  11. Review
  12. Review
  13. Article
  14. Review
  15. Review
  16. Article
  17. Stabilizing Extreme Few-Shot ECG Classification via Self-Supervised Contrastive Pretraining.Annals of noninvasive electrocardiology : the official journal of the International Society for Holter and Noninvasive Electrocardiology, Inc · 2026
    Article
  18. Article
  19. AI-Powered Clinical Decision Support in Dentistry: Comparative Evaluation of Large Language Models for Oral Medicine and Periodontal Diagnosis.Medical science monitor : international medical journal of experimental and clinical research · 2026
    Article
  20. Article

13 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Fiona R Kolbinger *Else Kroener Fresenius Center for Digital Health, TUD Dresden University of Technology, Dresden, Germany.ORCID http://orcid.org/0000-0003-2265-4809
Gregory P Veldhuizen *Else Kroener Fresenius Center for Digital Health, TUD Dresden University of Technology, Dresden, Germany.
Jiefu ZhuElse Kroener Fresenius Center for Digital Health, TUD Dresden University of Technology, Dresden, Germany.
Daniel TruhnDepartment of Diagnostic and Interventional Radiology, University Hospital Aachen, Aachen, Germany.ORCID http://orcid.org/0000-0002-9605-0728
Jakob Nikolas KatherElse Kroener Fresenius Center for Digital Health, TUD Dresden University of Technology, Dresden, Germany. jakob-nikolas.kather@alumni.dkfz.de.ORCID http://orcid.org/0000-0002-3730-5348

Funding

Indiana Clinical and Translational Sciences InstituteUM1TR004402 · NCATS · INDIANA UNIVERSITY INDIANAPOLIS · PI Sharon M Moe, Sarah Elizabeth Wiehe · 2023 to 2026
$21.6M
NCATS NIH HHS UM1 TR004402
6 · The paper itself

Abstract

backgroundThe field of Artificial Intelligence (AI) holds transformative potential in medicine. However, the lack of universal reporting guidelines poses challenges in ensuring the validity and reproducibility of published research studies in this field.

methodsBased on a systematic review of academic publications and reporting standards demanded by both international consortia and regulatory stakeholders as well as leading journals in the fields of medicine and medical informatics, 26 reporting guidelines published between 2009 and 2023 were included in this analysis. Guidelines were stratified by breadth (general or specific to medical fields), underlying consensus quality, and target research phase (preclinical, translational, clinical) and subsequently analyzed regarding the overlap and variations in guideline items.

resultsAI reporting guidelines for medical research vary with respect to the quality of the underlying consensus process, breadth, and target research phase. Some guideline items such as reporting of study design and model performance recur across guidelines, whereas other items are specific to particular fields and research stages.

conclusionsOur analysis highlights the importance of reporting guidelines in clinical AI research and underscores the need for common standards that address the identified variations and gaps in current guidelines. Overall, this comprehensive overview could help researchers and public stakeholders reinforce quality standards for increased reliability, reproducibility, clinical validity, and public trust in AI research in healthcare. This could facilitate the safe, effective, and ethical translation of AI methods into clinical applications that will ultimately improve patient outcomes.

Identifiers

PMID38605106
PMCPMC11009315

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.