Evidence map›Paper›PMID 38051562›Full record

ArticleJMIR formative research2023

The Implementation of a Virtual Emergency Department: Multimethods Study Guided by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) Framework.

Jennifer Shuldiner, Diya Srinivasan, Laura Desveaux, Justin N Hall

Open access · goldAbstract read
In one paragraph

Article in JMIR formative research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
3.1field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 9 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Barriers to and Facilitators of Technology Adoption in Emergency Departments: A Comprehensive Review.International journal of environmental research and public health · 2025
    Review
  9. Review
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 3 institutions in 1 country.

Jennifer ShuldinerWomen's College Hospital Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-2240-6274
Diya SrinivasanWomen's College Hospital Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-3115-9167
Laura DesveauxTrillium Health Partners, Mississauga, ON, Canada.ORCID https://orcid.org/0000-0003-3429-1865
Justin N HallDepartment of Emergency Medicine, Sunnybrook Health Sciences Centre, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-6211-9336
Women's College Hospital · CASunnybrook Health Science Centre · CATrillium Health Centre · CA

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundWhile the COVID-19 pandemic dramatically increased virtual care uptake across many health settings, it remains significantly underused in urgent care.

objectiveThis study evaluated the implementation of a pilot virtual emergency department (VED) at an Ontario hospital that connected patients to emergency physicians through a web-based portal. We sought to (1) assess the acceptability of the VED model, (2) evaluate whether the VED was implemented as intended, and (3) explore the impact on quality of care, access to care, and continuity of care.

methodsThis evaluation used a multimethods approach informed by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework. Data included semistructured interviews with patients and physicians as well as postvisit surveys from patients. Interviews were transcribed and analyzed using thematic analysis. Data from the surveys were described using summary statistics.

resultsFrom December 2020 to December 2021, the VED had a mean of 153 (SD 25) visits per month. Among them, 67% (n=677) were female, and 75% (n=758) had a family physician. Patients reported that the VED provided high-quality, timely access to care and praised the convenience, shorter appointments, and benefit of the calm, safe space afforded through virtual appointments. In instances where patients were directed to come into the emergency department (ED), physicians were able to provide a "warm handoff" to improve efficiency. This helped manage patient expectations, and the direct advice of the ED physician reassured them that the visit was warranted. There was broad initial uptake of VED shifts among ED physicians with 60% (n=22) completing shifts in the first 2 months and 42% (n=15) completing 1 or more shifts per month over the course of the pilot. There were no difficulties finding sufficient ED physicians for shifts. Most physicians enjoyed working in the VED, saw value for patients, and were motivated by patient satisfaction. However, some physicians were hesitant as they felt their expertise and skills as ED physicians were underused. The VED was implemented using an iterative staged approach with increased service capabilities over time, including access to ultrasounds, virtual follow-ups after a recent ED visit, and access to blood work, urine tests, and x-rays (at the hospital or a local community laboratory). Physicians recognized the value in supporting patients by advising on the need for an in-person visit, booking a diagnostic test, or referring them to a specialist.

conclusionsThe VED had the support of physicians and facilitated care for low-acuity presentations with immediate benefits for patients. It has the potential to benefit the health care system by seeing patients through the web and guiding patients to in-person care only when necessary. Long-term sustainability requires a focus on understanding digital equity and enhanced access to rapid testing or investigations.

Indexed as

digital emergency departmentemergency careemergency departmentevaluationimplementation sciencemixed methods evaluationpilottriagevirtual care

Identifiers

PMID38051562
PMCPMC10731546
OpenAlexW4389362728

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.