Evidence map›Paper›PMID 34296815›Full record

ArticleACR open rheumatology2021

Improving the Efficiency of Clinical Trial Recruitment Using an Ensemble Machine Learning to Assist With Eligibility Screening.

Tianrun Cai, Fiona Cai, Kumar P Dahal, Gabrielle Cremone, Ethan Lam, Charlotte Golnik, Thany Seyok, Chuan Hong, Tianxi Cai, Katherine P Liao

Abstract read
In one paragraph

Article in ACR open rheumatology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Review
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Artificial intelligence for optimizing recruitment and retention in clinical trials: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  12. Applying Artificial Intelligence in Pediatric Clinical Trials: Potential Impacts and Obstacles.The journal of pediatric pharmacology and therapeutics : JPPT : the official journal of PPAG · 2024
    Article
  13. Article
  14. Article
  15. Machine learning approaches for electronic health records phenotyping: a methodical review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  16. Text Classification of Cancer Clinical Trial Eligibility Criteria.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2023
    Article
  17. Article
  18. Review
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Tianrun CaiBrigham and Women's Hospital, Boston, Massachusetts, United States.ORCID https://orcid.org/0000-0001-5772-7460
Fiona CaiMassachusetts Institute of Technology, Cambridge, Massachusetts, United States.
Kumar P DahalBrigham and Women's Hospital, Boston, Massachusetts, United States.
Gabrielle CremoneBrigham and Women's Hospital, Boston, Massachusetts, United States.
Ethan LamBrigham and Women's Hospital, Boston, Massachusetts, United States.
Charlotte GolnikBrigham and Women's Hospital, Boston, Massachusetts, United States.
Thany SeyokBrigham and Women's Hospital, Boston, Massachusetts, United States.
Chuan HongHarvard University, Boston, Massachusetts, United States.
Tianxi CaiHarvard University, Boston, Massachusetts, United States.
Katherine P LiaoBrigham and Women's Hospital, Harvard University, and Veterans Affairs Boston Healthcare System, Boston, Massachusetts, United States.ORCID https://orcid.org/0000-0002-4797-3200

Funding

VERITY: Value and Evidence in Rheumatology using bioInformaTics, and advanced analYticsP30AR072577 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI Daniel Hal Solomon · 2017 to 2026
$9.8M
Lipids, Inflammation, and Cardiovascular Risk in Rheumatoid ArthritisR01HL127118 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI LIAO, KATHERINE PHOENIX · 2016 to 2020
$4.1M
National Heart Lung Blood Institute R01HL127118NHLBI NIH HHS R01 HL127118NIAMS NIH HHS P30 AR072577
6 · The paper itself

Abstract

objectiveEfficiently identifying eligible patients is a crucial first step for a successful clinical trial. The objective of this study was to test whether an approach using electronic health record (EHR) data and an ensemble machine learning algorithm incorporating billing codes and data from clinical notes processed by natural language processing (NLP) can improve the efficiency of eligibility screening.

methodsWe studied patients screened for a clinical trial of rheumatoid arthritis (RA) with one or more International Classification of Diseases (ICD) code for RA and age greater than 35 years, from a tertiary care center and a community hospital. The following three groups of EHR features were considered for the algorithm: 1) structured features, 2) the counts of NLP concepts from notes, 3) health care utilization. All features were linked to dates. We applied random forest and logistic regression with least absolute shrinkage and selection operator penalty against the following two standard approaches: 1) one or more RA ICD code and no ICD codes related to exclusion criteria (Screen

resultsIn total, 3359 patients at Brigham and Women's Hospital (BWH) and 642 patients at Faulkner Hospital (FH) were studied, with 461 (13.7%) eligible patients at BWH and 84 (13.4%) at FH. The application of the algorithm reduced ineligible patients from chart review by 40.5% at the tertiary care center and by 57.0% at the community hospital. In contrast, Screen

conclusionThe ensemble machine learning algorithm incorporating billing codes and NLP data increased the efficiency of eligibility screening by reducing the number of patients requiring chart review while not excluding eligible patients. Moreover, this approach can be trained at one institution and applied at another for multicenter clinical trials.

Identifiers

PMID34296815
PMCPMC8449035

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.