Evidence map›Paper›PMID 32673238›Full record

ArticleJMIR medical informatics2020

A Retrospective Analysis of Provider-to-Patient Secure Messages: How Much Are They Increasing, Who Is Doing the Work, and Is the Work Happening After Hours?

Frederick North, Kristine E Luhman, Eric A Mallmann, Toby J Mallmann, Sidna M Tulledge-Scheitel, Emily J North, Jennifer L Pecina

Abstract read
In one paragraph

Article in JMIR medical informatics, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed.

  1. A Comparative Study of Large Language Models, Human Experts, and Expert-Edited Large Language Models to Neuro-Ophthalmology Questions.Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society · 2025
    Trial
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. What patients want from healthcare chatbots: insights from a mixed-methods study.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Secure messaging telehealth billing in the digital age: moving beyond time-based metrics.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  15. Article
  16. Article
  17. Article
  18. Observational
  19. A scoping review of empathy recognition in text using natural language processing.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Frederick NorthDivision of Community Internal Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0002-3696-4595
Kristine E LuhmanMayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-8463-6724
Eric A MallmannUndergraduate Research Education Program, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-5758-0403
Toby J MallmannUndergraduate Research Education Program, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-2901-0336
Sidna M Tulledge-ScheitelDivision of Community Internal Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-5634-8397
Emily J NorthDepartment of Medicine, NYU Grossman School of Medicine, New York, NY, United States.ORCID https://orcid.org/0000-0002-6578-6572
Jennifer L PecinaDepartment of Family Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-1970-1344

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundPatient portal registration and the use of secure messaging are increasing. However, little is known about how the work of responding to and initiating patient messages is distributed among care team members and how these messages may affect work after hours.

objectiveThis study aimed to examine the growth of secure messages and determine how the work of provider responses to patient-initiated secure messages and provider-initiated secure messages is distributed across care teams and across work and after-work hours.

methodsWe collected secure messages sent from providers from January 1, 2013, to March 15, 2018, at Mayo Clinic, Rochester, Minnesota, both in response to patient secure messages and provider-initiated secure messages. We examined counts of messages over time, how the work of responding to messages and initiating messages was distributed among health care workers, messages sent per provider, messages per unique patient, and when the work was completed (proportion of messages sent after standard work hours).

resultsPortal registration for patients having clinic visits increased from 33% to 62%, and increasingly more patients and providers were engaged in messaging. Provider message responses to individual patients increased significantly in both primary care and specialty practices. Message responses per specialty physician provider increased from 15 responses per provider per year to 53 responses per provider per year from 2013 to 2018, resulting in a 253% increase. Primary care physician message responses increased from 153 per provider per year to 322 from 2013 to 2018, resulting in a 110% increase. Physicians, nurse practitioners, physician assistants, and registered nurses, all contributed to the substantial increases in the number of messages sent.

conclusionsProvider-sent secure messages at a large health care institution have increased substantially since implementation of secure messaging between patients and providers. The effort of responding to and initiating messages to patients was distributed across multiple provider categories. The percentage of message responses occurring after hours showed little substantial change over time compared with the overall increase in message volume.

Indexed as

communicationelectronic health recordselectronic mailnurse practitionersnursespatient messagespatient portalpatientsphysician assistantsphysiciansprovider messagessecure messages

Identifiers

PMID32673238
PMCPMC7381047

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.