Evidence map›Paper›PMID 36006692›Full record

ReviewJournal of medical Internet research2022

Guidelines for Artificial Intelligence in Medicine: Literature Review and Content Analysis of Frameworks.

Norah L Crossnohere, Mohamed Elsaid, Jonathan Paskett, Seuli Bose-Brill, John F P Bridges

Abstract readReview
In one paragraph

Review in Journal of medical Internet research, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 64 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
64citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

64 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Review
  11. Review
  12. AI-powered tools in family medicine: Bridging technology and practice.Journal of family medicine and primary care · 2026
    Article
  13. Article
  14. Frameworks for assessing digital health technologies: a scoping review.International journal of technology assessment in health care · 2026
    Article
  15. Article
  16. Review
  17. Article
  18. Healthcare delivery in the arctic-telehealth prospects.International journal of circumpolar health · 2025
    Review
  19. Article
  20. Article

4 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Norah L CrossnohereDepartment of Biomedical Informatics, The Ohio State University College of Medicine, Columbus, OH, United States.ORCID 0000-0002-2811-1330
Mohamed ElsaidDepartment of Biomedical Informatics, The Ohio State University College of Medicine, Columbus, OH, United States.ORCID 0000-0001-7963-2438
Jonathan PaskettDepartment of Biomedical Informatics, The Ohio State University College of Medicine, Columbus, OH, United States.ORCID 0000-0002-0488-7783
Seuli Bose-BrillDivision of General Internal Medicine, Department of Internal Medicine, The Ohio State University College of Medicine, Columbus, OH, United States.ORCID 0000-0003-4290-8992
John F P BridgesDepartment of Biomedical Informatics, The Ohio State University College of Medicine, Columbus, OH, United States.ORCID 0000-0002-3082-5535

Funding

The OSU Center for Clinical and Translational Science: Advancing Today's Discoveries to Improve HealthUL1TR002733 · NCATS · OHIO STATE UNIVERSITY · PI RINGEL, MATTHEW D · 2018 to 2022
$28.9M
NCATS NIH HHS UL1 TR002733
6 · The paper itself

Abstract

backgroundArtificial intelligence (AI) is rapidly expanding in medicine despite a lack of consensus on its application and evaluation.

objectiveWe sought to identify current frameworks guiding the application and evaluation of AI for predictive analytics in medicine and to describe the content of these frameworks. We also assessed what stages along the AI translational spectrum (ie, AI development, reporting, evaluation, implementation, and surveillance) the content of each framework has been discussed.

methodsWe performed a literature review of frameworks regarding the oversight of AI in medicine. The search included key topics such as "artificial intelligence," "machine learning," "guidance as topic," and "translational science," and spanned the time period 2014-2022. Documents were included if they provided generalizable guidance regarding the use or evaluation of AI in medicine. Included frameworks are summarized descriptively and were subjected to content analysis. A novel evaluation matrix was developed and applied to appraise the frameworks' coverage of content areas across translational stages.

resultsFourteen frameworks are featured in the review, including six frameworks that provide descriptive guidance and eight that provide reporting checklists for medical applications of AI. Content analysis revealed five considerations related to the oversight of AI in medicine across frameworks: transparency, reproducibility, ethics, effectiveness, and engagement. All frameworks include discussions regarding transparency, reproducibility, ethics, and effectiveness, while only half of the frameworks discuss engagement. The evaluation matrix revealed that frameworks were most likely to report AI considerations for the translational stage of development and were least likely to report considerations for the translational stage of surveillance.

conclusionsExisting frameworks for the application and evaluation of AI in medicine notably offer less input on the role of engagement in oversight and regarding the translational stage of surveillance. Identifying and optimizing strategies for engagement are essential to ensure that AI can meaningfully benefit patients and other end users.

Indexed as

Artificial IntelligenceMedicineChecklistHumansMachine LearningReproducibility of ResultsAIartificial intelligenceeffectivenessengagementethicshealth caremedicinereproducibilitytranslational researchtranslational sciencetransparency

Identifiers

PMID36006692
PMCPMC9459836

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.