Evidence map›Paper›PMID 24303321›Full record

ArticleAMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science2013

Evaluation considerations for EHR-based phenotyping algorithms: A case study for drug-induced liver injury.

Casey Lynnette Overby, Chunhua Weng, Krystl Haerian, Adler Perotte, Carol Friedman, George Hripcsak

Abstract read
In one paragraph

Article in AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Natural Language Processing for the Evaluation of Methodological Standards and Best Practices of EHR-based Clinical Research.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  4. Desiderata for computable representations of electronic health records-driven phenotype algorithms.Journal of the American Medical Informatics Association : JAMIA · 2015
    Article
  5. A knowledge-based, automated method for phenotyping in the EHR using only clinical pathology reports.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2015
    Article
  6. Article
  7. Defining a comprehensive verotype using electronic health records for personalized medicine.Journal of the American Medical Informatics Association : JAMIA · 2013
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Casey Lynnette OverbyDepartment of Biomedical Informatics, Columbia University, New York, NY.
Chunhua Weng
Krystl Haerian
Adler Perotte
Carol Friedman
George Hripcsak

Funding

Training in Biomedical Informatics at Columbia UniversityT15LM007079 · NLM · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI NOEMIE ELHADAD, GEORGE M HRIPCSAK · 1992 to 2026
$28.9M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
Biorepository for Genomic Medicine in diverse CommunitiesU01HG006380 · NHGRI · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI BOTTINGER, ERWIN P. · 2011 to 2015
$4.5M
Pharmacovigilence using Natural Language Processing, Statistics, and the EHRR01LM010016 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI FRIEDMAN, CAROL · 2009 to 2016
$3.4M
NHGRI NIH HHS U01 HG006380NLM NIH HHS R01 LM009886NLM NIH HHS R01 LM010016NLM NIH HHS T15 LM007079
6 · The paper itself

Abstract

Developing electronic health record (EHR) phenotyping algorithms involves generating queries that run across the EHR data repository. Algorithms are commonly assessed within demonstration studies. There remains, however, little emphasis on assessing the precision and accuracy of measurement methods during the evaluation process. Depending on the complexity of an algorithm, interim refinements may be required to improve measurement methods. Therefore, we develop an evaluation framework that incorporates both measurement and demonstration studies. We evaluate a baseline EHR phenotyping algorithm for drug induced liver injury (DILI) developed in collaboration with electronic Medical Records Genomics (eMERGE) network participants. We conduct a measurement study and report qualitative (i.e., perceptions of evaluation approach effectiveness) and quantitative (i.e., inter-rater reliability) measures. We also conduct a demonstration study and report qualitative (i.e., appropriateness of results) and quantitative (i.e., positive predictive value) measures. Given results from the measurement study, our evaluation approach underwent multiple changes including the addition of laboratory value visualization and an expanded review of clinical notes. Results from the demonstration study informed changes to our algorithm. For example, given the goal of eMERGE to identify patients who may have a genetic susceptibility to DILI, we excluded overdose patients.

Identifiers

PMID24303321
PMCPMC3814479

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.