Evidence map›Paper›PMID 32901441›Full record

Trial reportJournal of general internal medicine2021

Effect of Outpatient Note Templates on Note Quality: NOTE (Notation Optimization through Template Engineering) Randomized Clinical Trial.

Jeremy A Epstein, Joseph Cofrancesco, Mary Catherine Beach, Amanda Bertram, Helene F Hedian, Sara Mixter, Hsin-Chieh Yeh, Gail Berkenblit

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of general internal medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04333238 (Notation Optimization Through Template Engineering), which is not on this map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04333238 nacompletednot on this map

Notation Optimization Through Template Engineering

TypeinterventionalSponsorJohns Hopkins UniversityRan2017 to 2018Enrolled36ConditionsClinical DocumentationArmsNew progress note template, Standard progress note template
3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Article
  2. Article
  3. A fiscally sound, evidenced-based solution to conquering the complexity of physician billing guidelines: A physician-centric note template.Health information management : journal of the Health Information Management Association of Australia · 2025
    Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Comparison of medical documentation between pharmacist-led anticoagulation clinics and physician-led anticoagulation clinics: A retrospective study.Saudi pharmaceutical journal : SPJ : the official publication of the Saudi Pharmaceutical Society · 2023
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Clinical Thinking via Electronic Note Templates: Who Benefits?Journal of general internal medicine · 2021
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors.

Jeremy A EpsteinDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA. Epstein@jhmi.edu.ORCID 0000-0003-4435-7178
Joseph CofrancescoDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA.
Mary Catherine BeachDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA.
Amanda BertramDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA.
Helene F HedianDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA.
Sara MixterDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA.
Hsin-Chieh YehDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA.
Gail BerkenblitDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, Johns Hopkins Outpatient Center, Baltimore, MD, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThis is the first randomized controlled trial evaluating the impact of note template design on note quality using a simulated patient encounter and a validated assessment tool.

objectiveTo compare note quality between two different templates using a novel randomized clinical simulation process.

designA randomized non-blinded controlled trial of a standard note template versus redesigned template.

participantsPGY 1-3 IM residents.

interventionsResidents documented the simulated patient encounter using one of two templates. The standard template was modeled after the usual outpatient progress note. The new template placed the assessment and plan section in the beginning, grouped subjective data into the assessment, and deemphasized less useful elements. MAIN MEASURES: Note length; time to note completion; note template evaluation by resident authors; note evaluation by faculty reviewers. KEY

results36 residents participated, 19 randomized to standard template, 17 to new. New template generated shorter notes (103 vs 285 lines, p < 0.001) that took the same time to complete (19.8 vs 21.6 min, p = 0.654). Using a 5-point Likert scale, residents considered new notes to have increased visual appeal (4 vs 3, p = 0.05) and less redundancy and clutter (4 vs 3, p = 0.006). Overall template satisfaction was not statistically different. Faculty reviewers rated the standard note more up-to-date (4.3 vs 2.7, p = 0.001), accurate (3.9 vs 2.6, p = 0.003), and useful (4 vs 2.8, p = 0.002), but less organized (3.3 vs 4.5, p < 0.001). Total quality was not statistically different.

conclusionsResidents rated the new note template more visually appealing, shorter, and less cluttered. Faculty reviewers rated both note types equivalent in the overall quality but rated new notes inferior in terms of accuracy and usefulness though better organized. This study demonstrates a novel method of a simulated clinical encounter to evaluate note templates before the introduction into practice.

trial registrationClinicalTrials.gov ID: NCT04333238.

Indexed as

Medical RecordsOutpatientsHumansClinical documentationNote qualityNote template

Identifiers

PMID32901441
PMCPMC7947083

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.