Evidence map›Paper›PMID 37707946›Full record

ArticleJMIR formative research2023

Estimating Patient Satisfaction Through a Language Processing Model: Model Development and Evaluation.

Shinichi Matsuda, Takumi Ohtomo, Masaru Okuyama, Hiraku Miyake, Kotonari Aoki

Open access · goldAbstract read
In one paragraph

Article in JMIR formative research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
3.5field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 8 citations in OpenAlex.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Shinichi Matsuda *Drug Safety Division, Chugai Pharmaceutical Co Ltd, Tokyo, Japan.ORCID https://orcid.org/0000-0003-1822-1090
Takumi Ohtomo *Drug Safety Division, Chugai Pharmaceutical Co Ltd, Tokyo, Japan.ORCID https://orcid.org/0000-0002-6438-6315
Masaru OkuyamaInitiative Inc, Tokyo, Japan.ORCID https://orcid.org/0009-0000-5226-1243
Hiraku MiyakeInitiative Inc, Tokyo, Japan.ORCID https://orcid.org/0009-0001-4582-5749
Kotonari AokiDrug Safety Division, Chugai Pharmaceutical Co Ltd, Tokyo, Japan.ORCID https://orcid.org/0000-0002-1923-7003
U.S. President's Malaria Initiative · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMeasuring patient satisfaction is a crucial aspect of medical care. Advanced natural language processing (NLP) techniques enable the extraction and analysis of high-level insights from textual data; nonetheless, data obtained from patients are often limited.

objectiveThis study aimed to create a model that quantifies patient satisfaction based on diverse patient-written textual data.

methodsWe constructed a neural network-based NLP model for this cross-sectional study using the textual content from disease blogs written in Japanese on the Internet between 1994 and 2020. We extracted approximately 20 million sentences from 56,357 patient-authored disease blogs and constructed a model to predict the patient satisfaction index (PSI) using a regression approach. After evaluating the model's effectiveness, PSI was predicted before and after cancer notification to examine the emotional impact of cancer diagnoses on 48 patients with breast cancer.

resultsWe assessed the correlation between the predicted and actual PSI values, labeled by humans, using the test set of 169 sentences. The model successfully quantified patient satisfaction by detecting nuances in sentences with excellent effectiveness (Spearman correlation coefficient [ρ]=0.832; root-mean-squared error [RMSE]=0.166; P<.001). Furthermore, the PSI was significantly lower in the cancer notification period than in the preceding control period (-0.057 and -0.012, respectively; 2-tailed t

conclusionsOur model demonstrates the ability to quantify patient dissatisfaction and identify significant emotional changes during the disease course. This approach may also help detect issues in routine medical practice.

Indexed as

breast cancerinternetmachine learningnatural language processingnatural language-processing modelneural networkNLPpatient satisfactiontextual data

Identifiers

PMID37707946
PMCPMC10540017
OpenAlexW4385710616

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.