Evidence map›Paper›PMID 27497800›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2017

Evaluating electronic health record data sources and algorithmic approaches to identify hypertensive individuals.

Pedro L Teixeira, Wei-Qi Wei, Robert M Cronin, Huan Mo, Jacob P VanHouten, Robert J Carroll, Eric LaRose, Lisa A Bastarache, S Trent Rosenbloom, Todd L Edwards and 6 more

Open access · bronzeAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 54 papers.

0numbers the graph read from it
0cells of the map it votes in
54citing papers in PubMed
15.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

54 citing papers in PubMed, 95 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Semi-supervised ROC analysis for reliable and streamlined evaluation of phenotyping algorithms.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors at 2 institutions in 1 country.

Pedro L TeixeiraDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Wei-Qi WeiDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Robert M CroninDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Huan MoDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Jacob P VanHoutenDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Robert J CarrollDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Eric LaRoseBiomedical Informatics Research Center, Marshfield Clinic Research Foundation, 1000 N Oak Ave - ML8, Marshfield, WI 54449, USA.
Lisa A BastaracheDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
S Trent RosenbloomDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Todd L EdwardsDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Dan M RodenDepartment of Medicine, Vanderbilt University School of Medicine, Nashville, TN, USA.
Thomas A LaskoDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA.
Richard A DartCenter for Human Genetics, Marshfield Clinic Research Foundation, 1000 N Oak Ave-MLR, Marshfield, WI 54449, USA.
Anne M NikolaiBiomedical Informatics Research Center, Marshfield Clinic Research Foundation, 1000 N Oak Ave - ML8, Marshfield, WI 54449, USA.
Peggy L PeissigBiomedical Informatics Research Center, Marshfield Clinic Research Foundation, 1000 N Oak Ave - ML8, Marshfield, WI 54449, USA.
Joshua C DennyDepartment of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN, USA josh.denny@vanderbilt.edu.
Vanderbilt University · USMarshfield Clinic · US

Funding

MEDICAL SCIENTIST TRAINING PROGRAMT32GM007347 · NIGMS · VANDERBILT UNIVERSITY · PI WILLIAMS, CHRISTOPHER S. · 1985 to 2023
$26.3M
From GWAS to PheWAS: Scanning the EMR Phenome for Gene-disease AssociationsR01LM010685 · NLM · VANDERBILT UNIVERSITY MEDICAL CENTER · PI BASTARACHE, LISA · 2011 to 2022
$6.3M
National Infrastructure for Standardized and Portable EHR Phenotyping AlgorithmsR01GM105688 · NIGMS · WEILL MEDICAL COLL OF CORNELL UNIV · PI LUO, YUAN, PATHAK, JYOTISHMAN · 2013 to 2020
$5.7M
VGER, the Vanderbilt Genome-Electronic Records ProjectU01HG008672 · NHGRI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI DENNY, JOSHUA C., RODEN, DAN M · 2015 to 2019
$5.1M
IRIS: Incorporating Research Into SightU01HG006389 · NHGRI · ESSENTIA INSTITUTE OF RURAL HEALTH · PI MCCARTY, CATHERINE ANNE · 2011 to 2014
$4.1M
Vanderbilt Genome Electronic Records ProjectU01HG006378 · NHGRI · VANDERBILT UNIVERSITY · PI RODEN, DAN M · 2011 to 2014
$4.0M
COGENT consortium meta-analysis of blood pressure in African ancestry cohortsR21HL121429 · NHLBI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI EDWARDS, TODD L, VELEZ EDWARDS, DIGNA R · 2014 to 2015
$251k
NHGRI NIH HHS U01 HG006378NHGRI NIH HHS U01 HG006389NHGRI NIH HHS U01 HG008672NHLBI NIH HHS R21 HL121429NIGMS NIH HHS R01 GM105688NIGMS NIH HHS T32 GM007347NLM NIH HHS R01 LM010685
6 · The paper itself

Abstract

objectivePhenotyping algorithms applied to electronic health record (EHR) data enable investigators to identify large cohorts for clinical and genomic research. Algorithm development is often iterative, depends on fallible investigator intuition, and is time- and labor-intensive. We developed and evaluated 4 types of phenotyping algorithms and categories of EHR information to identify hypertensive individuals and controls and provide a portable module for implementation at other sites. MATERIALS AND

methodsWe reviewed the EHRs of 631 individuals followed at Vanderbilt for hypertension status. We developed features and phenotyping algorithms of increasing complexity. Input categories included International Classification of Diseases, Ninth Revision (ICD9) codes, medications, vital signs, narrative-text search results, and Unified Medical Language System (UMLS) concepts extracted using natural language processing (NLP). We developed a module and tested portability by replicating 10 of the best-performing algorithms at the Marshfield Clinic.

resultsRandom forests using billing codes, medications, vitals, and concepts had the best performance with a median area under the receiver operator characteristic curve (AUC) of 0.976. Normalized sums of all 4 categories also performed well (0.959 AUC). The best non-NLP algorithm combined normalized ICD9 codes, medications, and blood pressure readings with a median AUC of 0.948. Blood pressure cutoffs or ICD9 code counts alone had AUCs of 0.854 and 0.908, respectively. Marshfield Clinic results were similar.

conclusionThis work shows that billing codes or blood pressure readings alone yield good hypertension classification performance. However, even simple combinations of input categories improve performance. The most complex algorithms classified hypertension with excellent recall and precision.

Indexed as

AlgorithmsElectronic Health RecordsMachine LearningAgedBlood Pressure DeterminationClinical CodingFemaleHumansHypertensionInformation Storage and RetrievalMaleMiddle AgedNatural Language ProcessingPhenotypeROC Curveelectronic health recordshypertensionmachine learningnatural language processingphenotyping algorithmsrandom forests

Identifiers

PMID27497800
PMCPMC5201185
OpenAlexW2504897554

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.