Evidence map›Paper›PMID 39178307›Full record

ArticlePLOS digital health2024

Community-engaged artificial intelligence research: A scoping review.

Tyler J Loftus, Jeremy A Balch, Kenneth L Abbott, Die Hu, Matthew M Ruppert, Benjamin Shickel, Tezcan Ozrazgat-Baslanti, Philip A Efron, Patrick J Tighe, William R Hogan and 4 more

Abstract readScoping Review
In one paragraph

Article in PLOS digital health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. AI-Augmented Prevention Science Needs Community-Engaged Prevention Science: a Framework for Greater Accountability.Prevention science : the official journal of the Society for Prevention Research · 2026
    Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Tyler J LoftusUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.ORCID https://orcid.org/0000-0001-5354-443X
Jeremy A BalchUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.ORCID https://orcid.org/0000-0002-1826-7884
Kenneth L AbbottDepartment of Surgery, University of Florida Health, Gainesville, Florida, United States of America.
Die HuUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.
Matthew M RuppertUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.ORCID https://orcid.org/0000-0001-9757-4454
Benjamin ShickelUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.
Tezcan Ozrazgat-BaslantiUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.
Philip A EfronDepartment of Surgery, University of Florida Health, Gainesville, Florida, United States of America.
Patrick J TigheDepartments of Anesthesiology, Orthopedics, and Information Systems/Operations Management, University of Florida Health, Gainesville, Florida, United States of America.
William R HoganDepartment of Health Outcomes & Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, United States of America.ORCID https://orcid.org/0000-0002-9881-1017
Parisa RashidiUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.
Michelle I CardelDepartment of Health Outcomes & Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, United States of America.
Gilbert R UpchurchDepartment of Surgery, University of Florida Health, Gainesville, Florida, United States of America.
Azra BihoracUniversity of Florida Intelligent Clinical Care Center, Gainesville, Florida, United States of America.ORCID https://orcid.org/0000-0002-5745-2863

Funding

University of Florida Older Americans Independence Center (OAIC)P30AG028740 · NIA · UNIVERSITY OF FLORIDA · PI Peihua Qiu · 2007 to 2026
$22.8M
UF Clinical and Translational Science AwardUL1TR000064 · NCATS · UNIVERSITY OF FLORIDA · PI NELSON, DAVID R · 2012 to 2014
$12.2M
Integrating data, algorithms and clinical reasoning for surgical risk assessmentR01GM110240 · NIGMS · UNIVERSITY OF FLORIDA · PI BIHORAC, AZRA, RASHIDI, PARISA · 2016 to 2025
$5.1M
Molecular Biology in Burns and TraumaT32GM008721 · NIGMS · UNIVERSITY OF FLORIDA · PI Philip A Efron · 1999 to 2026
$5.0M
Aligning Patient Acuity with Intensity of Care after SurgeryK23GM140268 · NIGMS · UNIVERSITY OF FLORIDA · PI LOFTUS, TYLER J · 2020 to 2023
$619k
Development and Validation of Computational Algorithms to Assess Kidney Health in Electronic Health RecordsK01DK120784 · NIDDK · UNIVERSITY OF FLORIDA · PI OZRAZGAT BASLANTI, TEZCAN · 2020 to 2023
$580k
Autonomous Pain Recognition in Non-Verbal and Critically Ill PatientsR21EB027344 · NIBIB · UNIVERSITY OF FLORIDA · PI RASHIDI, PARISA · 2019 to 2022
$577k
NCATS NIH HHS UL1 TR000064NIA NIH HHS P30 AG028740NIBIB NIH HHS R21 EB027344NIDDK NIH HHS K01 DK120784NIGMS NIH HHS K23 GM140268NIGMS NIH HHS R01 GM110240NIGMS NIH HHS T32 GM008721
6 · The paper itself

Abstract

The degree to which artificial intelligence healthcare research is informed by data and stakeholders from community settings has not been previously described. As communities are the principal location of healthcare delivery, engaging them could represent an important opportunity to improve scientific quality. This scoping review systematically maps what is known and unknown about community-engaged artificial intelligence research and identifies opportunities to optimize the generalizability of these applications through involvement of community stakeholders and data throughout model development, validation, and implementation. Embase, PubMed, and MEDLINE databases were searched for articles describing artificial intelligence or machine learning healthcare applications with community involvement in model development, validation, or implementation. Model architecture and performance, the nature of community engagement, and barriers or facilitators to community engagement were reported according to PRISMA extension for Scoping Reviews guidelines. Of approximately 10,880 articles describing artificial intelligence healthcare applications, 21 (0.2%) described community involvement. All articles derived data from community settings, most commonly by leveraging existing datasets and sources that included community subjects, and often bolstered by internet-based data acquisition and subject recruitment. Only one article described inclusion of community stakeholders in designing an application-a natural language processing model that detected cases of likely child abuse with 90% accuracy using harmonized electronic health record notes from both hospital and community practice settings. The primary barrier to including community-derived data was small sample sizes, which may have affected 11 of the 21 studies (53%), introducing substantial risk for overfitting that threatens generalizability. Community engagement in artificial intelligence healthcare application development, validation, or implementation is rare. As healthcare delivery occurs primarily in community settings, investigators should consider engaging community stakeholders in user-centered design, usability, and clinical implementation studies to optimize generalizability.

Identifiers

PMID39178307
PMCPMC11343451

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.