Evidence map›Paper›PMID 38573301›Full record

Observational studyMayo Clinic proceedings2024

Predicting Primary Care Physician Burnout From Electronic Health Record Use Measures.

Daniel Tawfik, Mohsen Bayati, Jessica Liu, Liem Nguyen, Amrita Sinha, Thomas Kannampallil, Tait Shanafelt, Jochen Profit

Open access · hybridAbstract readObservational Study
In one paragraph

Observational study in Mayo Clinic proceedings, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
9.3field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it, 11 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Observational
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 1 country.

Daniel TawfikStanford University School of Medicine, Stanford, CA. Electronic address: dtawfik@stanford.edu.
Mohsen BayatiStanford Graduate School of Business, Stanford, CA.
Jessica LiuStanford University School of Medicine, Stanford, CA.
Liem NguyenStanford University School of Engineering, Stanford, CA.
Amrita SinhaHarvard Medical School, Boston, MA.
Thomas KannampallilWashington University School of Medicine in St Louis, St Louis, MO.
Tait ShanafeltStanford University School of Medicine, Stanford, CA; Stanford Medicine WellMD & WellPhD Center, Stanford, CA.
Jochen ProfitStanford University School of Medicine, Stanford, CA.
Stanford University · USStanford Medicine · USHarvard University · USWashington University in St. Louis · US

Funding

The WISER StudyR01HD084679 · NICHD · STANFORD UNIVERSITY · PI PROFIT, JOCHEN, SEXTON, JOHN BRYAN · 2015 to 2018
$2.2M
Development and Validation of a Prediction Model to Address Physician BurnoutK08HS027837 · AHRQ · STANFORD UNIVERSITY · PI TAWFIK, DANIEL · 2020 to 2024
$762k
AHRQ HHS K08 HS027837NICHD NIH HHS R01 HD084679
6 · The paper itself

Abstract

objectiveTo evaluate the ability of routinely collected electronic health record (EHR) use measures to predict clinical work units at increased risk of burnout and potentially most in need of targeted interventions.

methodsIn this observational study of primary care physicians, we compiled clinical workload and EHR efficiency measures, then linked these measures to 2 years of well-being surveys (using the Stanford Professional Fulfillment Index) conducted from April 1, 2019, through October 16, 2020. Physicians were grouped into training and confirmation data sets to develop predictive models for burnout. We used gradient boosting classifier and other prediction modeling algorithms to quantify the predictive performance by the area under the receiver operating characteristics curve (AUC).

resultsOf 278 invited physicians from across 60 clinics, 233 (84%) completed 396 surveys. Physicians were 67% women with a median age category of 45 to 49 years. Aggregate burnout score was in the high range (≥3.325/10) on 111 of 396 (28%) surveys. Gradient boosting classifier of EHR use measures to predict burnout achieved an AUC of 0.59 (95% CI, 0.48 to 0.77) and an area under the precision-recall curve of 0.29 (95% CI, 0.20 to 0.66). Other models' confirmation set AUCs ranged from 0.56 (random forest) to 0.66 (penalized linear regression followed by dichotomization). Among the most predictive features were physician age, team member contributions to notes, and orders placed with user-defined preferences. Clinic-level aggregate measures identified the top quartile of clinics with 56% sensitivity and 85% specificity.

conclusionIn a sample of primary care physicians, routinely collected EHR use measures demonstrated limited ability to predict individual burnout and moderate ability to identify high-risk clinics.

Indexed as

Burnout, ProfessionalElectronic Health RecordsPhysicians, Primary CareAdultFemaleHumansMaleMiddle AgedROC CurveSurveys and QuestionnairesWorkload

Identifiers

PMID38573301
PMCPMC11374508
OpenAlexW4393946691

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.