Evidence map›Paper›PMID 35090449›Full record

ArticleBMC medical informatics and decision making2022

Under-specification as the source of ambiguity and vagueness in narrative phenotype algorithm definitions.

Jingzhi Yu, Jennifer A Pacheco, Anika S Ghosh, Yuan Luo, Chunhua Weng, Ning Shang, Barbara Benoit, David S Carrell, Robert J Carroll, Ozan Dikilitas and 12 more

Abstract read
In one paragraph

Article in BMC medical informatics and decision making, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. PhenoFit: a framework for determining computable phenotyping algorithm fitness for purpose and reuse.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  2. Article
  3. Article
  4. A general framework for developing computable clinical phenotype algorithms.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  5. Characterizing variability of electronic health record-driven phenotype definitions.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

22 authors.

Jingzhi YuCenter for Health Information Partnerships (CHIP), Northwestern University Feinberg School of Medicine, 625 N. Michigan Ave, Suite. 1500, Chicago, IL, 60611, USA. k.yu@northwestern.edu.
Jennifer A PachecoNorthwestern University Feinberg School of Medicine, Chicago, IL, USA.
Anika S GhoshNorthwestern University Feinberg School of Medicine, Chicago, IL, USA.
Yuan LuoNorthwestern University Feinberg School of Medicine, Chicago, IL, USA.
Chunhua WengDepartment of Biomedical Informatics, Columbia University, New York, NY, USA.
Ning ShangDepartment of Biomedical Informatics, Columbia University, New York, NY, USA.
Barbara BenoitResearch IS and Computing, Massachusetts General Hospital Brigham, Somerville, MA, USA.
David S CarrellKaiser Permanente Washington Health Research Institute, Seattle, WA, USA.
Robert J CarrollDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA.
Ozan DikilitasDepartment of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA.
Robert R FreimuthDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
Vivian S GainerResearch IS and Computing, Massachusetts General Hospital Brigham, Somerville, MA, USA.
Hakon HakonarsonCenter for Applied Genomics, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
George HripcsakDepartment of Biomedical Informatics, Columbia University, New York, NY, USA.
Iftikhar J KulloDepartment of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA.
Frank MentchCenter for Applied Genomics, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Shawn N MurphyResearch IS and Computing, Massachusetts General Hospital Brigham, Somerville, MA, USA.
Peggy L PeissigBiomedical Informatics Research Center, Marshfield Clinic Research Institute, Marshfield, WI, USA.
Andrea H RamirezDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA.
Nephi WaltonIntermountain Precision Genomics, Intermountain Healthcare, St. George, UT, USA.
Wei-Qi WeiDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA.
Luke V RasmussenDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.

Funding

Genomic Basis of Susceptibility to COVID-19 Infection and its ComplicationsU01HG006379 · NHGRI · MAYO CLINIC ROCHESTER · PI Richard R. Sharp · 2011 to 2026
$16.5M
Finding Genomic Profiles of COVID-19 Phenotypes from the EHRU01HG008685 · NHGRI · BRIGHAM AND WOMEN'S HOSPITAL · PI ELIZABETH W KARLSON, Matthew S Lebo · 2015 to 2026
$13.6M
OMOP information model for eMERGE phenotypingU01HG008680 · NHGRI · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Wendy K Chung, GEORGE M HRIPCSAK · 2015 to 2026
$13.3M
VGER, the Vanderbilt Genome-Electronic Records ProjectU01HG008672 · NHGRI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI DENNY, JOSHUA C., RODEN, DAN M · 2015 to 2019
$5.1M
The Future of Genomics Medicine in Patient Care: Contributions from CHOPU01HG008684 · NHGRI · CHILDREN'S HOSP OF PHILADELPHIA · PI HAKONARSON, HAKON · 2015 to 2019
$5.0M
Genomic Medicine at Northwestern: Discovery and ImplementationU01HG008673 · NHGRI · NORTHWESTERN UNIVERSITY AT CHICAGO · PI CHISHOLM, REX L, SMITH, MAUREEN E · 2015 to 2019
$4.1M
NHGRI NIH HHS U01 HG006379NHGRI NIH HHS U01HG006379NHGRI NIH HHS U01 HG008672NHGRI NIH HHS U01HG008672NHGRI NIH HHS U01 HG008673NHGRI NIH HHS U01 HG008680NHGRI NIH HHS U01HG008680NHGRI NIH HHS U01 HG008684NHGRI NIH HHS U01HG008684NHGRI NIH HHS U01 HG008685NHGRI NIH HHS U01HG008685
6 · The paper itself

Abstract

introductionCurrently, one of the commonly used methods for disseminating electronic health record (EHR)-based phenotype algorithms is providing a narrative description of the algorithm logic, often accompanied by flowcharts. A challenge with this mode of dissemination is the potential for under-specification in the algorithm definition, which leads to ambiguity and vagueness.

methodsThis study examines incidents of under-specification that occurred during the implementation of 34 narrative phenotyping algorithms in the electronic Medical Record and Genomics (eMERGE) network. We reviewed the online communication history between algorithm developers and implementers within the Phenotype Knowledge Base (PheKB) platform, where questions could be raised and answered regarding the intended implementation of a phenotype algorithm.

resultsWe developed a taxonomy of under-specification categories via an iterative review process between two groups of annotators. Under-specifications that lead to ambiguity and vagueness were consistently found across narrative phenotype algorithms developed by all involved eMERGE sites. DISCUSSION AND

conclusionOur findings highlight that under-specification is an impediment to the accuracy and efficiency of the implementation of current narrative phenotyping algorithms, and we propose approaches for mitigating these issues and improved methods for disseminating EHR phenotyping algorithms.

Indexed as

AlgorithmsElectronic Health RecordsGenomicsHumansKnowledge BasesPhenotypeAlgorithm: Natural LanguageAmbiguityElectronic Health Records (EHR)PhenotypingUnder-SpecificationVagueness

Identifiers

PMID35090449
PMCPMC8796627

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.