ArticleJournal of the American Medical Informatics Association : JAMIA2015
Completeness, accuracy, and computability of National Quality Forum-specified eMeasures.
Article in Journal of the American Medical Informatics Association : JAMIA, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
11 citing papers in PubMed.
- Development and testing of data infrastructure in the American College of Emergency Physicians' Clinical Emergency Data Registry for opioid-related research.Journal of the American College of Emergency Physicians open · 2022Article
- Comparison of electronic versus manual abstraction for 2 standardized perinatal care measures.Journal of the American Medical Informatics Association : JAMIA · 2022Article
- Chasm Between Cancer Quality Measures and Electronic Health Record Data Quality.JCO clinical cancer informatics · 2022Article
- Quality of MBSAQIP data: bad luck, or lack of QA plan?Surgical endoscopy · 2020Article
- Automatic population of eMeasurements from EHR systems for inpatient falls.Journal of the American Medical Informatics Association : JAMIA · 2018Article
- Using Clinical Data Standards to Measure Quality: A New Approach.Applied clinical informatics · 2018Article
- Quantifying the Effect of Data Quality on the Validity of an eMeasure.Applied clinical informatics · 2017Article
- Using a stakeholder-engaged approach to develop and validate electronic clinical quality measures.Journal of the American Medical Informatics Association : JAMIA · 2017Article
- A new era of quality measurement in rheumatology: electronic clinical quality measures and national registries.Current opinion in rheumatology · 2017Review
- A Mixed Methods Task Analysis of the Implementation and Validation of EHR-Based Clinical Quality Measures.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2016Article
- Desiderata for computable representations of electronic health records-driven phenotype algorithms.Journal of the American Medical Informatics Association : JAMIA · 2015Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectiveTo analyze the completeness, computability, and accuracy of specifications for five National Quality Forum-specified (NQF) eMeasures spanning ambulatory, post-discharge, and emergency care within a comprehensive, integrated electronic health record (EHR) environment. MATERIALS AND
methodsTo evaluate completeness, we assessed eMeasure logic, data elements, and value sets. To evaluate computability, we assessed the translation of eMeasure algorithms to programmable logic constructs and the availability of EHR data elements to implement specified data criteria, using a de-identified clinical data set from Kaiser Permanente Northwest. To assess accuracy, we compared eMeasure results with those obtained independently by existing audited chart abstraction methods used for external and internal reporting.
resultsOne measure specification was incomplete; missing applicable LOINC codes rendered it non-computable. For three of four computable measures, data availability issues occurred; the literal specification guidance for a data element differed from the physical implementation of the data element in the EHR. In two cases, cross-referencing specified data elements to EHR equivalents allowed variably accurate measure computation. Substantial data availability issues occurred for one of the four computable measures, producing highly inaccurate results. DISCUSSION: Existing clinical workflows, documentation, and coding in the EHR were significant barriers to implementing eMeasures as specified. Implementation requires redesigning business or clinical practices and, for one measure, systemic EHR modifications, including clinical text search capabilities.
conclusionsFive NQF eMeasures fell short of being machine-consumable specifications. Both clinical domain and technological expertise are required to implement manually intensive steps from data mapping to text mining to EHR-specific eMeasure implementation.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.