Evidence map›Paper›PMID 36474423›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2023

Characterizing variability of electronic health record-driven phenotype definitions.

Pascal S Brandt, Abel Kho, Yuan Luo, Jennifer A Pacheco, Theresa L Walunas, Hakon Hakonarson, George Hripcsak, Cong Liu, Ning Shang, Chunhua Weng and 15 more

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. PhenoFit: a framework for determining computable phenotyping algorithm fitness for purpose and reuse.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  2. Article
  3. Review
  4. Article
  5. US public health surveillance, reimagined.Learning health systems · 2024
    Article
  6. Clinical Research Informatics: a Decade-in-Review.Yearbook of medical informatics · 2024
    Review
  7. Validation of an acute respiratory infection phenotyping algorithm to support robust computerised medical record-based respiratory sentinel surveillance, England, 2023.Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin · 2024
    Article
  8. Clinical Research Informatics: Contributions from 2023.Yearbook of medical informatics · 2024
    Review
  9. Article
  10. Improving reporting standards for phenotyping algorithm in biomedical research: 5 fundamental dimensions.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  11. Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

25 authors.

Pascal S BrandtDepartment of Biomedical and Medical Education, University of Washington, Seattle, Washington, USA.ORCID 0000-0001-5116-0555
Abel KhoDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.
Yuan LuoDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.ORCID 0000-0003-0195-7456
Jennifer A PachecoDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.ORCID 0000-0001-8021-5818
Theresa L WalunasDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.
Hakon HakonarsonCenter for Applied Genomics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA.ORCID 0000-0003-2814-7461
George HripcsakDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Cong LiuDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.ORCID 0000-0001-6024-3037
Ning ShangDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Chunhua WengDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Nephi WaltonIntermountain Precision Genomics, Intermountain Healthcare, St George, Utah, USA.
David S CarrellKaiser Permanente Washington Health Research Institute, Seattle, Washington, USA.ORCID 0000-0002-8471-0928
Paul K CraneDepartment of Medicine, University of Washington, Seattle, Washington, USA.
Eric B LarsonDepartment of Medicine, University of Washington, Seattle, Washington, USA.
Christopher G ChuteSchools of Medicine, Public Health, and Nursing, Johns Hopkins University, Baltimore, Maryland, USA.ORCID 0000-0001-5437-2545
Iftikhar J KulloDepartment of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota, USA.
Robert CarrollDepartment of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Josh DennyAll of Us Research Program, National Institutes of Health, Bethesda, Maryland, USA.
Andrea RamirezDepartment of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Wei-Qi WeiDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Jyoti PathakDepartment of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA.
Laura K WileyDepartment of Biomedical Informatics, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA.ORCID 0000-0001-6681-9754
Rachel RichessonDepartment of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, Michigan, USA.
Justin B StarrenDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.ORCID 0000-0002-5403-1115
Luke V RasmussenDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.ORCID 0000-0002-4497-8049

Funding

Technologies and Resources CoreU54MD007593 · NIMHD · MEHARRY MEDICAL COLLEGE · PI ADUNYAH, SAMUEL EVANS · 2012 to 2018
$24.7M
Genomic Basis of Susceptibility to COVID-19 Infection and its ComplicationsU01HG006379 · NHGRI · MAYO CLINIC ROCHESTER · PI Richard R. Sharp · 2011 to 2026
$16.5M
Finding Genomic Profiles of COVID-19 Phenotypes from the EHRU01HG008685 · NHGRI · BRIGHAM AND WOMEN'S HOSPITAL · PI ELIZABETH W KARLSON, Matthew S Lebo · 2015 to 2026
$13.6M
Variation, Function, and Disease Supplement ProgramU01HG008657 · NHGRI · UNIVERSITY OF WASHINGTON · PI David Russell Crosslin, Gail Pairitz Jarvik · 2015 to 2026
$13.4M
OMOP information model for eMERGE phenotypingU01HG008680 · NHGRI · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Wendy K Chung, GEORGE M HRIPCSAK · 2015 to 2026
$13.3M
DNA Sequencing Support for the eMERGE NetworkU01HG008664 · NHGRI · BAYLOR COLLEGE OF MEDICINE · PI GIBBS, RICHARD A · 2015 to 2019
$10.9M
Research Design, Data, and Analytics CoreP30DK092949 · NIDDK · UNIVERSITY OF CHICAGO · PI MILDA Renne SAUNDERS · 2011 to 2026
$10.0M
Global Alliance for Genomic Health (GA4GH)U01HG008676 · NHGRI · BRIGHAM AND WOMEN'S HOSPITAL · PI LENNON, NIALL JOHN, REHM, HEIDI L · 2015 to 2019
$8.6M
Northwestern Genomic Risk Assessment and Management ProgramU01HG011169 · NHGRI · NORTHWESTERN UNIVERSITY AT CHICAGO · PI REX L CHISHOLM, Elizabeth M McNally · 2020 to 2026
$7.4M
The Electronic Medical Records and Genomics (eMERGE) Network Phase III Coordinating Center (U01)U01HG008701 · NHGRI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI PETERSON, JOSEPH F. · 2015 to 2019
$7.1M
VGER, the Vanderbilt Genome-Electronic Records ProjectU01HG008672 · NHGRI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI DENNY, JOSHUA C., RODEN, DAN M · 2015 to 2019
$5.1M
The Future of Genomics Medicine in Patient Care: Contributions from CHOPU01HG008684 · NHGRI · CHILDREN'S HOSP OF PHILADELPHIA · PI HAKONARSON, HAKON · 2015 to 2019
$5.0M
NHGRI NIH HHS U01 HG006379NHGRI NIH HHS U01 HG008657NHGRI NIH HHS U01HG008657NHGRI NIH HHS U01 HG008664NHGRI NIH HHS U01 HG008666NHGRI NIH HHS U01 HG008672NHGRI NIH HHS U01 HG008673NHGRI NIH HHS U01 HG008676NHGRI NIH HHS U01 HG008679NHGRI NIH HHS U01 HG008680NHGRI NIH HHS U01 HG008684NHGRI NIH HHS U01 HG008685NHGRI NIH HHS U01 HG008701NHGRI NIH HHS U01 HG011169NIDDK NIH HHS P30 DK092949NIGMS NIH HHS R01 GM139891NIMHD NIH HHS U54 MD007593
6 · The paper itself

Abstract

objectiveThe aim of this study was to analyze a publicly available sample of rule-based phenotype definitions to characterize and evaluate the variability of logical constructs used. MATERIALS AND

methodsA sample of 33 preexisting phenotype definitions used in research that are represented using Fast Healthcare Interoperability Resources and Clinical Quality Language (CQL) was analyzed using automated analysis of the computable representation of the CQL libraries.

resultsMost of the phenotype definitions include narrative descriptions and flowcharts, while few provide pseudocode or executable artifacts. Most use 4 or fewer medical terminologies. The number of codes used ranges from 5 to 6865, and value sets from 1 to 19. We found that the most common expressions used were literal, data, and logical expressions. Aggregate and arithmetic expressions are the least common. Expression depth ranges from 4 to 27. DISCUSSION: Despite the range of conditions, we found that all of the phenotype definitions consisted of logical criteria, representing both clinical and operational logic, and tabular data, consisting of codes from standard terminologies and keywords for natural language processing. The total number and variety of expressions are low, which may be to simplify implementation, or authors may limit complexity due to data availability constraints.

conclusionsThe phenotype definitions analyzed show significant variation in specific logical, arithmetic, and other operators but are all composed of the same high-level components, namely tabular data and logical expressions. A standard representation for phenotype definitions should support these formats and be modular to support localization and shared logic.

Indexed as

Electronic Health RecordsLanguageNarrationPhenotypecohort identificationCQLEHR-driven phenotypingFHIR

Identifiers

PMID36474423
PMCPMC9933077

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.