Evidence map›Paper›PMID 37098602›Full record

ArticleImplementation science communications2023

A picture is worth a thousand words: advancing the use of visualization tools in implementation science through process mapping and matrix heat mapping.

Zachary M Salvati, Alanna Kulchak Rahm, Marc S Williams, Ilene Ladd, Victoria Schlieder, Jamie Atondo, Jennifer L Schneider, Mara M Epstein, Christine Y Lu, Pamala A Pawloski and 6 more

Open access · goldAbstract read
In one paragraph

Article in Implementation science communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
14.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it, 33 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors at 11 institutions in 1 country.

Zachary M SalvatiGeisinger Department of Genomic Health, 100 N. Academy Ave, Danville, PA, 17822, USA. zsalvati@geisinger.edu.ORCID http://orcid.org/0000-0001-9442-3220
Alanna Kulchak RahmGeisinger Department of Genomic Health, 100 N. Academy Ave, Danville, PA, 17822, USA.
Marc S WilliamsGeisinger Department of Genomic Health, 100 N. Academy Ave, Danville, PA, 17822, USA.
Ilene LaddGeisinger Department of Genomic Health, 100 N. Academy Ave, Danville, PA, 17822, USA.
Victoria SchliederGeisinger Department of Genomic Health, 100 N. Academy Ave, Danville, PA, 17822, USA.
Jamie AtondoGeisinger Department of Genomic Health, 100 N. Academy Ave, Danville, PA, 17822, USA.
Jennifer L SchneiderCenter for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Ave, Portland, OR, 97202, USA.
Mara M EpsteinDepartment of Medicine and the Meyers Primary Care Institute, University of Massachusetts Medical School, 365 Plantation St. Biotech 1, Suite 100, Worcester, MA, 01605, USA.
Christine Y LuDepartment of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, USA.
Pamala A PawloskiHealthPartners Institute, Bloomington, MN, USA.
Ravi N SharafDivision of Gastroenterology, Department of Medicine, Department of Healthcare Policy and Research, Weill Cornell Medicine, New York, NY, USA.
Su-Ying LiangPalo Alto Medical Foundation Research Institute, 795 El Camino Real, Palo Alto, CA, 94301, USA.
Andrea N Burnett-HartmanKaiser Permanente Colorado, Institute for Health Research, 2550 S. Parker Rd., Ste 200, Aurora, CO, 80014, USA.
Jessica Ezzell HunterRTI International, 3040 East Cornwallis Road, P.O. Box 12194, Research Triangle Park, NC, 27709-2194, USA.
Jasmine Burton-AkrightUniversity of South Florida, 3720 Spectrum Blvd, Suite 304, Tampa, FL, 33612, USA.
Deborah CragunUniversity of South Florida, 3720 Spectrum Blvd, Suite 304, Tampa, FL, 33612, USA.
Genomic Health (United States) · USUniversity of South Florida · USCornell University · USGeisinger Medical Center · USHarvard University · USHealthPartners · USKaiser Permanente · USKaiser Permanente Center for Health Research · USPalo Alto Institute · USRTI International · USUniversity of Massachusetts Chan Medical School · US

Funding

Implementing Universal Lynch Syndrome Screening across Multiple Healthcare Systems: Identifying Strategies to Facilitate and Maintain Programs in Different Organizational ContextsR01CA211723 · NCI · GEISINGER CLINIC · PI RAHM, ALANNA K · 2017 to 2021
$3.7M
NCI NIH HHS R01 CA211723
6 · The paper itself

Abstract

backgroundIdentifying key determinants is crucial for improving program implementation and achieving long-term sustainment within healthcare organizations. Organizational-level complexity and heterogeneity across multiple stakeholders can complicate our understanding of program implementation. We describe two data visualization methods used to operationalize implementation success and to consolidate and select implementation factors for further analysis.

methodsWe used a combination of process mapping and matrix heat mapping to systematically synthesize and visualize qualitative data from 66 stakeholder interviews across nine healthcare organizations, to characterize universal tumor screening programs of all newly diagnosed colorectal and endometrial cancers and understand the influence of contextual factors on implementation. We constructed visual representations of protocols to compare processes and score process optimization components. We also used color-coded matrices to systematically code, summarize, and consolidate contextual data using factors from the Consolidated Framework for Implementation Research (CFIR). Combined scores were visualized in a final data matrix heat map.

resultsNineteen process maps were created to visually represent each protocol. Process maps identified the following gaps and inefficiencies: inconsistent execution of the protocol, no routine reflex testing, inconsistent referrals after a positive screen, no evidence of data tracking, and a lack of quality assurance measures. These barriers in patient care helped us define five process optimization components and used these to quantify program optimization on a scale from 0 (no program) to 5 (optimized), representing the degree to which a program is implemented and optimally maintained. Combined scores within the final data matrix heat map revealed patterns of contextual factors across optimized programs, non-optimized programs, and organizations with no program.

conclusionsProcess mapping provided an efficient method to visually compare processes including patient flow, provider interactions, and process gaps and inefficiencies across sites, thereby measuring implementation success via optimization scores. Matrix heat mapping proved useful for data visualization and consolidation, resulting in a summary matrix for cross-site comparisons and selection of relevant CFIR factors. Combining these tools enabled a systematic and transparent approach to understanding complex organizational heterogeneity prior to formal coincidence analysis, introducing a stepwise approach to data consolidation and factor selection.

Indexed as

CancerConsolidated Framework for Implementation Research (CFIR)Data visualizationImplementationLynch syndromeMatrix heat mappingOptimizationProcess mappingTumor screening

Identifiers

PMID37098602
PMCPMC10127322
OpenAlexW4366986864

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.