Evidence map›Paper›PMID 38129617›Full record

Observational studyJournal of general internal medicine2024

Patient Portal Message Volume and Time Spent on the EHR: an Observational Study of Primary Care Clinicians.

Kathryn A Martinez, Rebecca Schulte, Michael B Rothberg, Maria Charmaine Tang, Elizabeth R Pfoh

Abstract readObservational Study
In one paragraph

Observational study in Journal of general internal medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Observational
  10. Burden of administrative responsibilities in primary care: Qualitative study.Canadian family physician Medecin de famille canadien · 2025
    Article
  11. Article
  12. Article
  13. Article
  14. Secure messaging telehealth billing in the digital age: moving beyond time-based metrics.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  15. Appointments aren't Access: The Hidden Work of Getting Care.Journal of primary care & community health
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Kathryn A MartinezCenter for Value-Based Care Research, Cleveland Clinic, Cleveland, OH, USA. martink12@ccf.org.ORCID 0000-0001-9177-480X
Rebecca SchulteDepartment of Quantitative Health Sciences, Cleveland Clinic, Cleveland, OH, USA.
Michael B RothbergCenter for Value-Based Care Research, Cleveland Clinic, Cleveland, OH, USA.
Maria Charmaine TangDepartment of Pediatrics, Cleveland Clinic, Cleveland, OH, USA.
Elizabeth R PfohCenter for Value-Based Care Research, Cleveland Clinic, Cleveland, OH, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAs patient-initiated messaging rises, identifying variation in message volume and its relationship to clinician workload is essential.

objectiveTo describe the association between variation in message volume over time and time spent on the electronic health record (EHR) outside of scheduled hours.

designRetrospective cohort study.

participantsPrimary care clinicians at Cleveland Clinic Health System. MAIN MEASURES: We categorized clinicians according to their number of quarterly incoming medical advice messages (i.e., message volume) between January 2019 and December 2021 using group-based trajectory modeling. We assessed change in quarterly messages and outpatient visits between October-December 2019 (Q4) and October-December 2021 (Q12). The primary outcome was time outside of scheduled hours spent on the EHR. We used mixed effects logistic regression to describe the association between incoming portal messages and time spent on the EHR by clinician messaging group and at the clinician level. KEY

resultsAmong the 150 clinicians, 31% were in the low-volume group (206 messages per quarter per clinician), 47% were in the moderate-volume group (505 messages), and 22% were in the high-volume group (840 messages). Mean quarterly messages increased from 340 to 695 (p < 0.001) between Q4 and Q12; mean quarterly outpatient visits fell from 711 to 575 (p = 0.005). While time spent on the EHR outside of scheduled hours increased modestly for all clinicians, this did not significantly differ by message group. Across all clinicians, each additional 10 messages was associated with an average of 12 min per quarter of additional time spent on the EHR (p < 0.001).

conclusionsMessage volume increased substantially over the study period and varied by group. While messages were associated with additional time spent on the EHR outside of scheduled hours, there was no significant difference in time spent on the EHR between the high and low message volume groups.

Indexed as

Electronic Health RecordsPatient PortalsHumansPrimary Health CareRetrospective StudiesWorkload

Identifiers

PMID38129617
PMCPMC10973312

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.