Evidence map›Paper›PMID 40053805›Full record

ArticleJMIR medical informatics2025

Performance Improvement of a Natural Language Processing Tool for Extracting Patient Narratives Related to Medical States From Japanese Pharmaceutical Care Records by Increasing the Amount of Training Data: Natural Language Processing Analysis and Validation Study.

Yukiko Ohno, Tohru Aomori, Tomohiro Nishiyama, Riri Kato, Reina Fujiki, Haruki Ishikawa, Keisuke Kiyomiya, Minae Isawa, Mayumi Mochizuki, Eiji Aramaki and 1 more

Abstract readValidation Study
In one paragraph

Article in JMIR medical informatics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Yukiko OhnoGraduate School of Pharmaceutical Sciences, Keio University, Tokyo, Japan.ORCID 0009-0001-2378-2629
Tohru AomoriFaculty of Pharmacy, Takasaki University of Health and Welfare, Takasaki, Japan.ORCID 0000-0001-7697-6446
Tomohiro NishiyamaNara Institute of Science and Technology, Ikoma, Japan.ORCID 0000-0003-1538-8266
Riri KatoFaculty of Pharmacy, Keio University, Tokyo, Japan.ORCID 0009-0007-0029-743X
Reina FujikiDepartment of Pharmacy, Keio University Hospital, Tokyo, Japan.ORCID 0009-0005-8682-9294
Haruki IshikawaDepartment of Pharmacy, Keio University Hospital, Tokyo, Japan.ORCID 0009-0004-0633-5482
Keisuke KiyomiyaFaculty of Pharmacy, Keio University, Tokyo, Japan.ORCID 0009-0004-1586-6357
Minae IsawaFaculty of Pharmacy, Keio University, Tokyo, Japan.ORCID 0009-0007-3068-0800
Mayumi MochizukiFaculty of Pharmacy, Keio University, Tokyo, Japan.ORCID 0000-0001-6772-4327
Eiji AramakiNara Institute of Science and Technology, Ikoma, Japan.ORCID 0000-0003-0201-3609
Hisakazu OhtaniGraduate School of Pharmaceutical Sciences, Keio University, Tokyo, Japan.ORCID 0000-0002-4089-9407

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundPatients' oral expressions serve as valuable sources of clinical information to improve pharmacotherapy. Natural language processing (NLP) is a useful approach for analyzing unstructured text data, such as patient narratives. However, few studies have focused on using NLP for narratives in the Japanese language.

objectiveWe aimed to develop a high-performance NLP system for extracting clinical information from patient narratives by examining the performance progression with a gradual increase in the amount of training data.

methodsWe used subjective texts from the pharmaceutical care records of Keio University Hospital from April 1, 2018, to March 31, 2019, comprising 12,004 records from 6559 cases. After preprocessing, we annotated diseases and symptoms within the texts. We then trained and evaluated a deep learning model (bidirectional encoder representations from transformers combined with a conditional random field [BERT-CRF]) through 10-fold cross-validation. The annotated data were divided into 10 subsets, and the amount of training data was progressively increased over 10 steps. We also analyzed the causes of errors. Finally, we applied the developed system to the analysis of case report texts to evaluate its usability for texts from other sources.

resultsThe F

conclusionsWe successfully developed a high-performance system specialized in analyzing subjective data from pharmaceutical care records by training a large dataset, with near-complete saturation of system performance with about 3600 training records. This system will be useful for monitoring symptoms, offering benefits for both clinical practice and research.

Indexed as

Data MiningElectronic Health RecordsNarrationNatural Language ProcessingPharmaceutical ServicesDeep LearningJapandeep learningelectronic medical recordEMRJapanesenamed entity recognitionnatural language processingNERNLPpharmaceutical care record

Identifiers

PMID40053805
PMCPMC11920660

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.