Evidence map›Paper›PMID 38447587›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2024

Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer's disease and related dementias.

Betina Idnay, Jianfang Liu, Yilu Fang, Alex Hernandez, Shivani Kaw, Alicia Etwaru, Janeth Juarez Padilla, Sergio Ozoria Ramírez, Karen Marder, Chunhua Weng and 1 more

Open access · greenAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact, top 97% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed, 0 citations in OpenAlex.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 1 institution in 1 country.

Betina IdnaySchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.ORCID 0000-0002-4318-5987
Jianfang LiuSchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
Yilu FangDepartment of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY 10032, United States.ORCID 0000-0002-2681-1931
Alex HernandezSchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
Shivani KawSchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
Alicia EtwaruSchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
Janeth Juarez PadillaSchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
Sergio Ozoria RamírezSchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
Karen MarderDepartment of Neurology, Columbia University Irving Medical Center, New York, NY 10032, United States.
Chunhua WengDepartment of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY 10032, United States.ORCID 0000-0002-9624-0214
Rebecca SchnallSchool of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.ORCID 0000-0003-2184-4045
Columbia University Irving Medical Center · US

Funding

Clinical and Translational Science AwardUL1TR001873 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI REILLY, MUREDACH P · 2016 to 2025
$99.0M
Training in Biomedical Informatics at Columbia UniversityT15LM007079 · NLM · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI NOEMIE ELHADAD, GEORGE M HRIPCSAK · 1992 to 2026
$28.9M
Reducing Health Disparities Through Informatics - Genomics SupplementT32NR007969 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SUZANNE BAKKEN, Rebecca Schnall · 2002 to 2026
$7.9M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
Reaching Communities through the Design of Information Visualizations (ReDIVis) Toolbox to Address COVID-19 Vaccine Hesitancy and Uptake.P30NR016587 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI BAKKEN, SUZANNE, SMALDONE, ARLENE M · 2016 to 2022
$4.3M
Translator Red Knowledge (TReK)OT2TR003434 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI DUMONTIER, MICHEL, TA, CASEY NGHIA · 2020 to 2024
$2.3M
Mentoring and Research in Self-Management for Health Promotion and Disease PreventionK24NR018621 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SCHNALL, REBECCA · 2019 to 2022
$384k
Improving Eligibility Prescreening for Alzheimer's Disease and Related Dementias Clinical Trials with Natural Language ProcessingR36HS028752 · AHRQ · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI IDNAY, BETINA ROSS SALDUA · 2022 to 2022
$21k
AHRQ HHS R36 HS028752NCATS NIH HHS OT2 TR003434NCATS NIH HHS UL1 TR001873NIH HHSNINR NIH HHS K24 NR018621NINR NIH HHS P30 NR016587NINR NIH HHS T32 NR007969NINR NIH HHS T32NR007969NLM NIH HHS R01 LM009886NLM NIH HHS R01LM009886NLM NIH HHS T15 LM007079
6 · The paper itself

Abstract

backgroundAlzheimer's disease and related dementias (ADRD) affect over 55 million globally. Current clinical trials suffer from low recruitment rates, a challenge potentially addressable via natural language processing (NLP) technologies for researchers to effectively identify eligible clinical trial participants.

objectiveThis study investigates the sociotechnical feasibility of NLP-driven tools for ADRD research prescreening and analyzes the tools' cognitive complexity's effect on usability to identify cognitive support strategies.

methodsA randomized experiment was conducted with 60 clinical research staff using three prescreening tools (Criteria2Query, Informatics for Integrating Biology and the Bedside [i2b2], and Leaf). Cognitive task analysis was employed to analyze the usability of each tool using the Health Information Technology Usability Evaluation Scale. Data analysis involved calculating descriptive statistics, interrater agreement via intraclass correlation coefficient, cognitive complexity, and Generalized Estimating Equations models.

resultsLeaf scored highest for usability followed by Criteria2Query and i2b2. Cognitive complexity was found to be affected by age, computer literacy, and number of criteria, but was not significantly associated with usability. DISCUSSION: Adopting NLP for ADRD prescreening demands careful task delegation, comprehensive training, precise translation of eligibility criteria, and increased research accessibility. The study highlights the relevance of these factors in enhancing NLP-driven tools' usability and efficacy in clinical research prescreening.

conclusionUser-modifiable NLP-driven prescreening tools were favorably received, with system type, evaluation sequence, and user's computer literacy influencing usability more than cognitive complexity. The study emphasizes NLP's potential in improving recruitment for clinical trials, endorsing a mixed-methods approach for future system evaluation and enhancements.

Indexed as

Alzheimer DiseaseMedical InformaticsEligibility DeterminationFeasibility StudiesHumansNatural Language Processingclinical trialinformaticsresearch recruitment

Identifiers

PMID38447587
PMCPMC11031244
OpenAlexW4392565297

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.