Evidence map›Paper›PMID 36927606›Full record

ArticleJMIR formative research2023

Time Utilization Among Immunization Clinics Using an Electronic Immunization Registry (Part 2): Time and Motion Study of Modified User Workflows.

Samantha B Dolan, Rachel Wittenauer, Anne Njoroge, Penina Onyango, George Owiso, Jessica C Shearer, William B Lober, Shan Liu, Nancy Puttkammer, Peter Rabinowitz

Open access · goldFull text read
In one paragraph

Article in JMIR formative research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
2.2field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 9 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 4 institutions in 2 countries.

Samantha B DolanInternational Training and Education Center for Health, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0001-8088-6611
Rachel WittenauerDepartment of Global Health, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0002-6606-8708
Anne NjorogeInternational Training and Education Center for Health, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0001-8158-2847
Penina OnyangoCounty Department of Health, Siaya, Kenya.ORCID https://orcid.org/0000-0003-2168-5726
George OwisoInternational Training and Education Center for Health, University of Washington, Nairobi, Kenya.ORCID https://orcid.org/0000-0002-2768-9181
Jessica C ShearerPATH, Seattle, WA, United States.ORCID https://orcid.org/0000-0003-1025-5739
William B LoberDepartment of Global Health, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0002-1053-7501
Shan LiuDepartment of Industrial and Systems Engineering, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0003-1459-8923
Nancy PuttkammerInternational Training and Education Center for Health, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0002-6693-9278
Peter RabinowitzInternational Training and Education Center for Health, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0002-6873-0208
University of Washington · USGates Foundation · USNakuru County Council · KEProgram for Appropriate Technology in Health · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDigital health interventions have the potential to improve the provision of health care services through digitized data collection and management. Low- and middle-income countries are beginning to introduce electronic immunization registries (EIRs) into their routine immunization services to better capture and store childhood vaccination information. Especially in Africa, where 25% of children remain unimmunized or underimmunized, technologies that can help identify children due for a vaccination are particularly important for improving vaccination coverage. However, an improved understanding of the effectiveness of these systems is needed to develop and deploy sustainable EIRs in low- and middle-income countries.

objectiveWe conducted an interventional pretest-posttest design study that sought to improve time efficiency through workflow modifications in Kenyan immunization clinics. Our aim was to describe how activity times differed after introducing workflow modifications that could potentially reduce the time needed to perform routine data entry activities. Our intent was to demonstrate changes in efficiency when moving from the existing dual-data entry workflow to a future paperless workflow by health facility size and experience length of health care workers (HCWs).

methodsWe tested how 3 workflow modifications would affect time utilization among HCWs using the EIR at the point of care compared with baseline immunization clinic workflows. Our outcome of interest was the time taken to complete individual activities and a patient's total time in the clinic where we compared the time spent during the baseline workflow with that during the modified workflow. We used a standardized tool to observe and document the immunization clinic workflow. To estimate differences in time utilization, we used bivariate analyses and fit multivariate linear mixed-effects models.

resultsOur study found that for HCWs using an EIR, the introduction of modified workflows decreased the amount of time needed to provide services to children seen in the immunization clinic. With a baseline mean time of 10 minutes spent per child, this decreased by about 3 minutes when the preparation modification was introduced and almost 5 minutes for the paperless and combined modifications. Results pertaining to the EIR's performance and ability to connect to the internet were particularly insightful about potential causes of delays.

conclusionsWe were able to conduct a concise clinical simulation exercise by introducing modified workflows and estimating their impact on time utilization in immunization clinics using an EIR. We found that the paperless workflow provided the largest time savings when delivering services, although this was threatened by poor EIR performance and internet connectivity. This study demonstrated that not only should digital health interventions be built and adapted for particular use cases but existing user workflows also need to adapt to new technology.

Indexed as

digital health interventionelectronic immunization registryimmunizationsmixed methods evaluationtime and motionworkflow

Identifiers

PMID36927606
PMCPMC10019767
OpenAlexW4312669680

What OpenQuestion holds

Textfull text, public
LicenceCC BY
measurements read53
table measurements read3
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.