Evidence map›Paper›PMID 39759773›Full record

ReviewJAMIA open2025

Guidelines and standard frameworks for artificial intelligence in medicine: a systematic review.

Kirubel Biruk Shiferaw, Moritz Roloff, Irina Balaur, Danielle Welter, Dagmar Waltemath, Atinkut Alamirrew Zeleke

Abstract readReview
In one paragraph

Review in JAMIA open, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. Article
  9. Artificial intelligence-enabled histological analysis in pre-clinical respiratory disease models: a scoping review.European respiratory review : an official journal of the European Respiratory Society · 2026
    Article
  10. AI-Powered Clinical Decision Support in Dentistry: Comparative Evaluation of Large Language Models for Oral Medicine and Periodontal Diagnosis.Medical science monitor : international medical journal of experimental and clinical research · 2026
    Article
  11. Review
  12. Review
  13. Article
  14. Can We Have Guidelines or Just Guidance for Rare Fungal Infections?Journal of fungi (Basel, Switzerland) · 2025
    Article
  15. Artificial intelligence in pediatric medicine: a call for rigorous reporting standards.Journal of perinatology : official journal of the California Perinatal Association · 2025
    Article
  16. Technological Advances in Pre-Operative Planning.Journal of clinical medicine · 2025
    Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Kirubel Biruk ShiferawDepartment of Medical Informatics, Institute for Community Medicine, University Medicine Greifswald, Greifswald D-17475, Germany.ORCID https://orcid.org/0000-0002-7411-1411
Moritz RoloffDepartment of Medical Informatics, Institute for Community Medicine, University Medicine Greifswald, Greifswald D-17475, Germany.
Irina BalaurLuxembourg Centre for Systems Biology, University of Luxembourg, Belvaux L-4367, Luxembourg.ORCID https://orcid.org/0000-0002-3671-895X
Danielle WelterLuxembourg National Data Service, Esch-sur-Alzette L-4362, Luxembourg.
Dagmar WaltemathDepartment of Medical Informatics, Institute for Community Medicine, University Medicine Greifswald, Greifswald D-17475, Germany.ORCID https://orcid.org/0000-0002-5886-5563
Atinkut Alamirrew ZelekeDepartment of Medical Informatics, Institute for Community Medicine, University Medicine Greifswald, Greifswald D-17475, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objectives: The continuous integration of artificial intelligence (AI) into clinical settings requires the development of up-to-date and robust guidelines and standard frameworks that consider the evolving challenges of AI implementation in medicine. This review evaluates the quality of these guideline and summarizes ethical frameworks, best practices, and recommendations. Materials and Methods: The Appraisal of Guidelines, Research, and Evaluation II tool was used to assess the quality of guidelines based on 6 domains: scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence. The protocol of this review including the eligibility criteria, the search strategy data extraction sheet and methods, was published prior to the actual review with International Registered Report Identifier of DERR1-10.2196/47105. Results: The initial search resulted in 4975 studies from 2 databases and 7 studies from manual search. Eleven articles were selected for data extraction based on the eligibility criteria. We found that while guidelines generally excel in scope, purpose, and editorial independence, there is significant variability in applicability and the rigor of guideline development. Well-established initiatives such as TRIPOD+AI, DECIDE-AI, SPIRIT-AI, and CONSORT-AI have shown high quality, particularly in terms of stakeholder involvement. However, applicability remains a prominent challenge among the guidelines. The result also showed that the reproducibility, ethical, and environmental aspects of AI in medicine still need attention from both medical and AI communities. Discussion: Our work highlights the need for working toward the development of integrated and comprehensive reporting guidelines that adhere to the principles of Findability, Accessibility, Interoperability and Reusability. This alignment is essential for fostering a cultural shift toward transparency and open science, which are pivotal milestone for sustainable digital health research. Conclusion: This review evaluates the current reporting guidelines, discussing their advantages as well as challenges and limitations.

Indexed as

AGREE IIartificial intelligencedigital medicineframeworkguidelinesmachine learningmedical informaticsmedicinequalitystandardsystematic review

Identifiers

PMID39759773
PMCPMC11700560

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.