Evidence map›Paper›PMID 39613295›Full record

ArticleJournal of the American Pharmacists Association : JAPhA

Risk stratification of potential drug interactions involving common over-the-counter medications and herbal supplements by a large language model.

John Kim, John W R Kincaid, Arya S Rao, Winston Lie, Lanting Fuh, Adam B Landman, Marc D Succi

Abstract read
In one paragraph

Article in Journal of the American Pharmacists Association : JAPhA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Review
  2. Article
  3. Drug-drug interaction identification using large language models.medRxiv : the preprint server for health sciences · 2025
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

John Kim
John W R Kincaid
Arya S Rao
Winston Lie
Lanting Fuh
Adam B Landman
Marc D Succi

Funding

Medical Scientist Training ProgramT32GM144273 · NIGMS · HARVARD MEDICAL SCHOOL · PI David Shumway Jones, Jacqueline A. Lees · 2022 to 2026
$14.7M
NIGMS NIH HHS T32 GM144273
6 · The paper itself

Abstract

backgroundAs polypharmacy, the use of over-the-counter (OTC) drugs, and herbal supplements becomes increasingly prevalent, the potential for adverse drug-drug interactions (DDIs) poses significant challenges to patient safety and health care outcomes.

objectiveThis study evaluates the capacity of Generative Pre-trained Transformer (GPT) models to accurately assess DDIs involving prescription drugs (Rx) with OTC medications and herbal supplements.

methodsLeveraging a popular subscription-based tool (Lexicomp), we compared the risk ratings assigned by these models to 43 Rx-OTC and 30 Rx-herbal supplement pairs.

resultsOur findings reveal that all models generally underperform, with accuracies below 50% and poor agreement with Lexicomp standards as measured by Cohen's kappa. Notably, GPT-4 and GPT-4o demonstrated a modest improvement in identifying higher-risk interactions compared to GPT-3.5.

conclusionThese results highlight the challenges and limitations of using off-the-shelf large language models for guidance in DDI assessment.

Indexed as

Dietary SupplementsHerb-Drug InteractionsNonprescription DrugsDrug InteractionsHumansLarge Language ModelsPlant PreparationsPolypharmacyPrescription DrugsRisk AssessmentNonprescription DrugsPlant PreparationsPrescription Drugs

Identifiers

PMID39613295
PMCPMC12042285

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.