Evidence map›Paper›PMID 32734161›Full record

ArticleJAMIA open2020

Evaluation of an artificial intelligence clinical trial matching system in Australian lung cancer patients.

Marliese Alexander, Benjamin Solomon, David L Ball, Mimi Sheerin, Irene Dankwa-Mullan, Anita M Preininger, Gretchen Purcell Jackson, Dishan M Herath

Open access · goldAbstract read
In one paragraph

Article in JAMIA open, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
41citing papers in PubMed, 2 pooled it
5.2field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

41 citing papers in PubMed, 2 syntheses or guidelines pooled it, 82 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Review
  6. Article
  7. Review
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Review
  17. Review
  18. A Deployed Online Reinforcement Learning Algorithm In An Oral Health Clinical Trial.Proceedings of the ... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence · 2025
    Article
  19. Article
  20. Artificial intelligence for optimizing recruitment and retention in clinical trials: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 3 institutions in 2 countries.

Marliese AlexanderDepartment of Pharmacy, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia.
Benjamin SolomonSir Peter MacCallum Department of Oncology, University of Melbourne, Parkville, Victoria, Australia.
David L BallSir Peter MacCallum Department of Oncology, University of Melbourne, Parkville, Victoria, Australia.
Mimi SheerinIBM Watson Health, Cambridge, Massachusetts, USA.
Irene Dankwa-MullanIBM Watson Health, Cambridge, Massachusetts, USA.
Anita M PreiningerIBM Watson Health, Cambridge, Massachusetts, USA.ORCID 0000-0001-8011-9391
Gretchen Purcell JacksonIBM Watson Health, Cambridge, Massachusetts, USA.
Dishan M HerathDepartment of Medical Oncology, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia.
IBM (United States) · USThe University of Melbourne · AUPeter MacCallum Cancer Centre · AU

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThe objective of this technical study was to evaluate the performance of an artificial intelligence (AI)-based system for clinical trials matching for a cohort of lung cancer patients in an Australian cancer hospital.

methodsA lung cancer cohort was derived from clinical data from patients attending an Australian cancer hospital. Ten phases I-III clinical trials registered on clinicaltrials.gov and open to lung cancer patients at this institution were utilized for assessments. The trial matching system performance was compared to a gold standard established by clinician consensus for trial eligibility.

resultsThe study included 102 lung cancer patients. The trial matching system evaluated 7252 patient attributes (per patient median 74, range 53-100) against 11 467 individual trial eligibility criteria (per trial median 597, range 243-4132). Median time for the system to run a query and return results was 15.5 s (range 7.2-37.8). In establishing the gold standard, clinician interrater agreement was high (Cohen's kappa 0.70-1.00). On a per-patient basis, the performance of the trial matching system for eligibility was as follows: accuracy, 91.6%; recall (sensitivity), 83.3%; precision (positive predictive value), 76.5%; negative predictive value, 95.7%; and specificity, 93.8%. DISCUSSION AND

conclusionThe AI-based clinical trial matching system allows efficient and reliable screening of cancer patients for clinical trials with 95.7% accuracy for exclusion and 91.6% accuracy for overall eligibility assessment; however, clinician input and oversight are still required. The automated system demonstrates promise as a clinical decision support tool to prescreen a large patient cohort to identify subjects suitable for further assessment.

Indexed as

clinical trial matchingmachine learningnatural language processing

Identifiers

PMID32734161
PMCPMC7382632
OpenAlexW3021833419

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.