Evidence map›Paper›PMID 38608915›Full record

ArticleJournal of biomedical informatics2024

Leveraging generative AI for clinical evidence synthesis needs to ensure trustworthiness.

Gongbo Zhang, Qiao Jin, Denis Jered McInerney, Yong Chen, Fei Wang, Curtis L Cole, Qian Yang, Yanshan Wang, Bradley A Malin, Mor Peleg and 4 more

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

14 authors.

Gongbo ZhangColumbia University, Department of Biomedical Informatics, New York, 10032, USA.
Qiao JinNational Institutes of Health, National Library of Medicine, National Center for Biotechnology Information, Bethesda, 20894, USA.
Denis Jered McInerneyNortheastern University, the Khoury College of Computer Sciences, Boston 02115, USA.
Yong ChenUniversity of Pennsylvania, Department of Biostatistics, Epidemiology and Informatics, Philadelphia 19104, USA.
Fei WangWeill Cornell Medicine, Department of Population Health Sciences, New York 10065, USA; Weill Cornell Medicine, Institute of AI for Digital Health, New York 10065, USA.
Curtis L ColeWeill Cornell Medicine, Department of Population Health Sciences, New York 10065, USA; Weill Cornell Medicine, Department of Medicine, New York 10065, USA.
Qian YangCornell University, Computing and Information Science, Ithaca 14853, USA.
Yanshan WangUniversity of Pittsburgh, Department of Health Information Management, Pittsburgh 15260, USA.
Bradley A MalinVanderbilt University Medical Center, Department of Biomedical Informatics, Nashville 37203, USA; Vanderbilt University Medical Center, Department of Biostatistics, Nashville 37203, USA; Vanderbilt University, Department of Computer Science, Nashville 37212, USA.
Mor PelegUniversity of Haifa, Department of Information Systems, Haifa 3498838, Israel.
Byron C WallaceNortheastern University, the Khoury College of Computer Sciences, Boston 02115, USA.
Zhiyong LuNational Institutes of Health, National Library of Medicine, National Center for Biotechnology Information, Bethesda, 20894, USA.
Chunhua WengColumbia University, Department of Biomedical Informatics, New York, 10032, USA. Electronic address: cw2384@cumc.columbia.edu.
Yifan PengWeill Cornell Medicine, Department of Population Health Sciences, New York 10065, USA. Electronic address: yip4002@med.cornell.edu.

Funding

Clinical and Translational Science AwardUL1TR001873 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI REILLY, MUREDACH P · 2016 to 2025
$99.0M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
ClinEX - Clinical Evidence Extraction, Representation, and AppraisalR01LM014344 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Yong Chen, Yifan Peng · 2023 to 2026
$2.7M
Closing the loop with an automatic referral population and summarization systemR01LM014306 · NLM · WEILL MEDICAL COLL OF CORNELL UNIV · PI Yifan Peng, Justin Frederick Rousseau · 2023 to 2026
$2.7M
Semi-Automating Data Extraction for Systematic ReviewsR01LM012086 · NLM · UNIVERSITY OF TEXAS AT AUSTIN · PI MARSHALL, IAIN, WALLACE, BYRON CASEY · 2015 to 2022
$2.4M
Targeted Neural Text Summarization of Electronic Medical Records to Improve Imaging DiagnosticsR01LM013772 · NLM · NORTHEASTERN UNIVERSITY · PI WALLACE, BYRON CASEY, YOUNG, GEOFFREY · 2022 to 2024
$1.0M
NCATS NIH HHS UL1 TR001873NLM NIH HHS R01 LM009886NLM NIH HHS R01 LM012086NLM NIH HHS R01 LM013772NLM NIH HHS R01 LM014306NLM NIH HHS R01 LM014344
6 · The paper itself

Abstract

Evidence-based medicine promises to improve the quality of healthcare by empowering medical decisions and practices with the best available evidence. The rapid growth of medical evidence, which can be obtained from various sources, poses a challenge in collecting, appraising, and synthesizing the evidential information. Recent advancements in generative AI, exemplified by large language models, hold promise in facilitating the arduous task. However, developing accountable, fair, and inclusive models remains a complicated undertaking. In this perspective, we discuss the trustworthiness of generative AI in the context of automated summarization of medical evidence.

Indexed as

Artificial IntelligenceEvidence-Based MedicineHumansNatural Language ProcessingTrustEvidence-based medicineLarge language modelsMedical evidence summarizationTrustworthy generative AI

Identifiers

PMID38608915
PMCPMC11217921

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.