Evidence map›Paper›PMID 36478460›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2023

Characterizing the macrostructure of electronic health record work using raw audit logs: an unsupervised action embeddings approach.

Sunny S Lou, Hanyang Liu, Derek Harford, Chenyang Lu, Thomas Kannampallil

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Review
  7. Article
  8. Review
  9. Article
  10. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Sunny S LouDepartment of Anesthesiology, School of Medicine, Washington University in St Louis, St Louis, Missouri, USA.
Hanyang LiuDepartment of Computer Science and Engineering, McKelvey School of Engineering, Washington University in St Louis, St Louis, Missouri, USA.
Derek HarfordDepartment of Anesthesiology, School of Medicine, Washington University in St Louis, St Louis, Missouri, USA.
Chenyang LuDepartment of Computer Science and Engineering, McKelvey School of Engineering, Washington University in St Louis, St Louis, Missouri, USA.
Thomas KannampallilDepartment of Anesthesiology, School of Medicine, Washington University in St Louis, St Louis, Missouri, USA.ORCID 0000-0003-4119-4836

Funding

TRAINING PROGRAM IN ANESTHESIOLOGY RESEARCHT32GM108539 · NIGMS · WASHINGTON UNIVERSITY · PI Aaron J Norris · 2014 to 2026
$4.9M
NIGMS NIH HHS T32 GM108539NIH HHS 5T32GM108539-07
6 · The paper itself

Abstract

Raw audit logs provide a comprehensive record of clinicians' activities on an electronic health record (EHR) and have considerable potential for studying clinician behaviors. However, research using raw audit logs is limited because they lack context for clinical tasks, leading to difficulties in interpretation. We describe a novel unsupervised approach using the comparison and visualization of EHR action embeddings to learn context and structure from raw audit log activities. Using a dataset of 15 767 634 raw audit log actions performed by 88 intern physicians over 6 months of EHR use across inpatient and outpatient settings, we demonstrated that embeddings can be used to learn the situated context for EHR-based work activities, identify discrete clinical workflows, and discern activities typically performed across diverse contexts. Our approach represents an important methodological advance in raw audit log research, facilitating the future development of metrics and predictive models to measure clinician behaviors at the macroscale.

Indexed as

Electronic Health RecordsPhysiciansHumansclinical workflowraw audit logsunsupervised learning

Identifiers

PMID36478460
PMCPMC9933072

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.