Evidence map›Paper›PMID 42004487›Full record

ArticleESMO real world data and digital oncology2026

Transforming oncology clinical trial matching through neuro-symbolic, multi-agent AI and an oncology-specific knowledge graph: a prospective evaluation in 3804 patients.

A Loaiza-Bonilla, C Yost, S Kurnaz, E Tuysuz, N G Thaker, D Giritlioglu, J P Noel Meza

Abstract read
In one paragraph

Article in ESMO real world data and digital oncology, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Review
  6. Article
  7. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

A Loaiza-BonillaSt. Luke's University Health Network, Easton, USA.
C YostCreighton University School of Medicine, Phoenix, USA.
S KurnazMassive Bio, Inc., Boca Raton, USA.
E TuysuzMassive Bio, Inc., Boca Raton, USA.
N G ThakerCapital Health, Pennington, USA.
D GiritliogluMassive Bio, Inc., Boca Raton, USA.
J P Noel MezaMassive Bio, Inc., Boca Raton, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Clinical trial enrollment in oncology remains critically low, with fewer than 5% of eligible adults participating, in large part due to the complexity and labor intensity of eligibility screening. We prospectively evaluated a neuro-symbolic, multi-agent artificial intelligence (AI) platform integrating domain-specific large language model (LLM) agents, an oncology-specific knowledge graph, a real-time recommendation engine, and human-in-the-loop review to determine whether automated extraction and reasoning can safely improve trial identification, efficiency, and equity at scale. Methods: Consecutive patients [ Results: The multi-agent neuro-symbolic system achieved an F1 score of 0.82 (95% confidence interval 0.81-0.83). In comparison, the GPT-4 zero-shot baseline achieved an F1 of 0.47, and the GPT-4 chain-of-thought baseline achieved an F1 of 0.67. Per-patient screening time decreased from a median of 120 min (manual review) to ∼30 min total (15 min automated processing + 15 min clinical review). Across the cohort, the system processed 157 000 pages, screened 23 912 candidate patient-trial pairs, and produced 17 912 oncologist-confirmed matches, with median time-to-recommendation <7 days. No demographic subgroup exceeded a 10-percentage point F1 gap; the largest observed difference was ∼7 points between white and black/African American patients. Ablation experiments showed that both knowledge graph grounding and multi-agent decomposition contributed materially to performance and efficiency. Eligibility confidence scores exhibited reasonable calibration in the clinically relevant operating range. Conclusions: A neuro-symbolic, multi-agent architecture that couples LLM-based extraction with ontology-grounded, deterministic eligibility reasoning improved the accuracy, throughput, and timeliness of oncology clinical trial matching versus LLM-only baselines, while preserving clinician oversight and maintaining modest subgroup performance gaps. These results support scalable, equity-aware deployment of AI-assisted trial screening in routine oncology practice.

Indexed as

clinical trial matchingknowledge graphlarge language models (LLMs)multi-agent systemsneuro-symbolic AIoncology decision support

Identifiers

PMID42004487
PMCPMC13091143

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.