Evidence map›Paper›PMID 39070967›Full record

ArticleJAMIA open2024

Development and application of Breadth-Depth-Context (BDC), a conceptual framework for measuring technology engagement with a qualified clinical data registry.

Emma Kersey, Jing Li, Julia Kay, Julia Adler-Milstein, Jinoos Yazdany, Gabriela Schmajuk

Abstract read
In one paragraph

Article in JAMIA open, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Emma KerseyDepartment of Medicine, Division of Rheumatology, University of California San Francisco, San Francisco, CA 94143, United States.ORCID https://orcid.org/0009-0001-5637-7515
Jing LiDepartment of Medicine, Division of Rheumatology, University of California San Francisco, San Francisco, CA 94143, United States.ORCID https://orcid.org/0000-0002-3298-2112
Julia KayDepartment of Medicine, Division of Rheumatology, University of California San Francisco, San Francisco, CA 94143, United States.ORCID https://orcid.org/0000-0002-8081-5896
Julia Adler-MilsteinInstitute for Health Policy Studies, University of California San Francisco, San Francisco, CA 94158, United States.ORCID https://orcid.org/0000-0002-0262-6491
Jinoos YazdanyDepartment of Medicine, Division of Rheumatology, University of California San Francisco, San Francisco, CA 94143, United States.ORCID https://orcid.org/0000-0002-3508-4094
Gabriela SchmajukDepartment of Medicine, Division of Rheumatology, University of California San Francisco, San Francisco, CA 94143, United States.ORCID https://orcid.org/0000-0003-2687-5043

Funding

RESOURCE-BASED CENTER FOR THE ADVANCEMENT OF PRECISION MEDICINE IN RHEUMATOLOGYP30AR070155 · NIAMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Mary C Nakamura · 2016 to 2026
$8.2M
Impact of Registry Use on Quality and Outcomes in Rheumatology (QORA)R01AR079566 · NIAMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI SCHMAJUK, GABRIELA, YAZDANY, JINOOS · 2021 to 2025
$3.3M
Advancing Quality and Outcomes Measurement in RheumatologyK24AR074534 · NIAMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jinoos Yazdany · 2019 to 2026
$1.5M
AHRQ HHS R01 HS028024NIAMS NIH HHS K24 AR074534NIAMS NIH HHS P30 AR070155NIAMS NIH HHS R01 AR079566
6 · The paper itself

Abstract

Objectives: Despite the proliferation of dashboards that display performance data derived from Qualified Clinical Data Registries (QCDR), the degree to which clinicians and practices engage with such dashboards has not been well described. We aimed to develop a conceptual framework for assessing user engagement with dashboard technology and to demonstrate its application to a rheumatology QCDR. Materials and Methods: We developed the BDC (Breadth-Depth-Context) framework, which included concepts of breadth (derived from dashboard sessions), depth (derived from dashboard actions), and context (derived from practice characteristics). We demonstrated its application via user log data from the American College of Rheumatology's Rheumatology Informatics System for Effectiveness (RISE) registry to define engagement profiles and characterize practice-level factors associated with different profiles. Results: We applied the BDC framework to 213 ambulatory practices from the RISE registry in 2020-2021, and classified practices into 4 engagement profiles: not engaged (8%), minimally engaged (39%), moderately engaged (34%), and most engaged (19%). Practices with more patients and with specific electronic health record vendors (eClinicalWorks and eMDs) had a higher likelihood of being in the most engaged group, even after adjusting for other factors. Discussion: We developed the BDC framework to characterize user engagement with a registry dashboard and demonstrated its use in a specialty QCDR. The application of the BDC framework revealed a wide range of breadth and depth of use and that specific contextual factors were associated with nature of engagement. Conclusion: Going forward, the BDC framework can be used to study engagement with similar dashboards.

Indexed as

audit log dataclinical dashboardframeworkuser engagementuser profiles

Identifiers

PMID39070967
PMCPMC11278873

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.