Evidence map›Paper›PMID 33576432›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2021

Mining tasks and task characteristics from electronic health record audit logs with unsupervised machine learning.

Bob Chen, Wael Alrifai, Cheng Gao, Barrett Jones, Laurie Novak, Nancy Lorenzi, Daniel France, Bradley Malin, You Chen

Open access · greenAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 1 pooled it
6.8field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 1 synthesis or guideline pooled it, 37 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Observational
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Using electronic health record audit log data for research: insights from early efforts.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  17. Team is brain: leveraging EHR audit log data for new insights into acute care processes.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  18. Article
  19. Article
  20. Inferring EHR Utilization Workflows through Audit Logs.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 2 institutions in 1 country.

Bob ChenEpithelial Biology Center, Vanderbilt University Medical Center, Nashville, Tennessee, USA.ORCID 0000-0003-1508-1758
Wael AlrifaiDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Cheng GaoDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Barrett JonesDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Laurie NovakDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.ORCID 0000-0002-0415-4301
Nancy LorenziDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Daniel FranceDepartment of Anesthesiology, Center for Research and Innovation in Systems Safety, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Bradley MalinDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
You ChenDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Vanderbilt University Medical Center · USVanderbilt University · US

Funding

Discovering Care Coordination Practice Patterns in the EMR: Interpretation and Impact on Patient OutcomesR01LM012854 · NLM · VANDERBILT UNIVERSITY MEDICAL CENTER · PI CHEN, YOU · 2019 to 2022
$1.5M
BIDS: Vanderbilt Training Program in BIg Biomedical Data ScienceT32LM012412 · NLM · VANDERBILT UNIVERSITY · PI BLUME, JEFFREY D., GADD, CYNTHIA S · 2016 to 2020
$1.5M
NLM NIH HHS R01 LM012854NLM NIH HHS T32 LM012412
6 · The paper itself

Abstract

objectiveThe characteristics of clinician activities while interacting with electronic health record (EHR) systems can influence the time spent in EHRs and workload. This study aims to characterize EHR activities as tasks and define novel, data-driven metrics. MATERIALS AND

methodsWe leveraged unsupervised learning approaches to learn tasks from sequences of events in EHR audit logs. We developed metrics characterizing the prevalence of unique events and event repetition and applied them to categorize tasks into 4 complexity profiles. Between these profiles, Mann-Whitney U tests were applied to measure the differences in performance time, event type, and clinician prevalence, or the number of unique clinicians who were observed performing these tasks. In addition, we apply process mining frameworks paired with clinical annotations to support the validity of a sample of our identified tasks. We apply our approaches to learn tasks performed by nurses in the Vanderbilt University Medical Center neonatal intensive care unit.

resultsWe examined EHR audit logs generated by 33 neonatal intensive care unit nurses resulting in 57 234 sessions and 81 tasks. Our results indicated significant differences in performance time for each observed task complexity profile. There were no significant differences in clinician prevalence or in the frequency of viewing and modifying event types between tasks of different complexities. We presented a sample of expert-reviewed, annotated task workflows supporting the interpretation of their clinical meaningfulness.

conclusionsThe use of the audit log provides an opportunity to assist hospitals in further investigating clinician activities to optimize EHR workflows.

Indexed as

Electronic Health RecordsUnsupervised Machine LearningHumansInfant, NewbornIntensive Care Units, NeonatalWorkflowWorkloadaudit logselectronic health recordshuman-computer interaction, clinician activitiesmetricstasksUnsupervised learning

Identifiers

PMID33576432
PMCPMC8200270
OpenAlexW3129040096

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.