Evidence map›Paper›PMID 34015944›Full record

ArticlePsychiatric services (Washington, D.C.)2021

Online Reviews of Mental Health Treatment Facilities: Narrative Themes Associated With Positive and Negative Ratings.

Daniel C Stokes, Rachel Kishton, Haley J McCalpin, Arthur P Pelullo, Zachary F Meisel, Rinad S Beidas, Raina M Merchant

Abstract read
In one paragraph

Article in Psychiatric services (Washington, D.C.), 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Daniel C StokesPenn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.
Rachel KishtonPenn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.
Haley J McCalpinPenn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.
Arthur P PelulloPenn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.
Zachary F MeiselPenn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.
Rinad S BeidasPenn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.
Raina M MerchantPenn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.

Funding

Analyzing Online Reviews to Evaluate Quality of Care at Substance Use Disorder Treatment FacilitiesR21DA050761 · NIDA · UNIVERSITY OF PENNSYLVANIA · PI MERCHANT, RAINA · 2020 to 2021
$446k
NIDA NIH HHS R21 DA050761
6 · The paper itself

Abstract

objectivePrevious studies indicate that patients' satisfaction with mental health care is correlated with both treatment outcomes and quality of life. The aims of this study were to describe online reviews of mental health treatment facilities, including key themes in review content, and to evaluate the correlation between narrative review themes, facility characteristics, and review ratings.

methodsUnited States National Mental Health Services Survey (N-MHSS) facilities were linked to corresponding Yelp pages, created between March 2007 and September 2019. Correlations between review ratings and both machine learning-generated latent Dirichlet allocation topics and N-MHSS-reported facility characteristics were measured by using Spearman's rank-order correlation coefficient. Significance was defined by a Bonferroni-adjusted p<0.001.

resultsOf 10,191 unique mental health treatment facilities, 1,383 (13.6%) had relevant Yelp pages with 8,133 corresponding reviews. The number of newly reviewed facilities and the number of new reviews increased throughout the study period. Narrative topics positively correlated with review ratings included caring staff (Spearman's ρ=0.39) and nonpharmacologic treatment (ρ=0.16). Topics negatively correlated with review ratings included rude staff (ρ=-0.14) and safety and abuse (ρ=-0.14). Of 126 N-MHSS survey items, 11 were positively correlated with review rating, including "outpatient mental health facility" (ρ=0.13), and 33 were negatively correlated with review rating, including accepting Medicare (ρ=-0.21).

conclusionsNarrative topics provide information beyond what is currently collected through the N-MHSS. Topics associated with positive and negative reviews, such as staff attitude toward patients, can guide improvement in patients' satisfaction and engagement with mental health care.

Indexed as

Mental HealthQuality of LifeAgedHumansMedicarePatient SatisfactionQuality of Health CareUnited StatesNatural language processingPatient satisfactionQuality of care

Identifiers

PMID34015944
PMCPMC9116241

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.