Evidence map›Paper›PMID 27472449›Full record

ArticlePloS one2016

Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.

Todd Lingren, Pei Chen, Joseph Bochenek, Finale Doshi-Velez, Patty Manning-Courtney, Julie Bickel, Leah Wildenger Welchons, Judy Reinhold, Nicole Bing, Yizhao Ni and 18 more

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in PloS one, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03394859 (Electronic Medical Records and Genomics), which is not on this map. Cited by 44 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
44citing papers in PubMed, 1 pooled it
4.7field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03394859 completednot on this map

Electronic Medical Records and Genomics (eMERGE) Phase III

TypeobservationalSponsorVanderbilt University Medical CenterRan2015 to 2020Enrolled25,380ConditionsCardiac Disease, Cancer, Hypercholesterolemia, Diabetes
3 · Its place in the literature

Who cites it

44 citing papers in PubMed, 1 synthesis or guideline pooled it, 84 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Review
  6. Article
  7. Article
  8. Review
  9. Transparent deep learning to identify autism spectrum disorders (ASD) in EHR using clinical notes.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. A practical approach to identifying autistic adults within the electronic health record.Autism research : official journal of the International Society for Autism Research · 2023
    Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

28 authors at 6 institutions in 1 country.

Todd LingrenCincinnati Children's Hospital Medical Center, Division of Biomedical Informatics, Cincinnati, Ohio, United States of America.ORCID http://orcid.org/0000-0003-0311-7100
Pei ChenBoston Children's Hospital, Center for Systems Biology, Boston, Massachusetts, United States of America.
Joseph BochenekVanderbilt University School of Medicine, Biomedical Informatics, Nashville, Tennessee, United States of America.
Finale Doshi-VelezHarvard Medical School, Center for Biomedical Informatics, Boston, Massachusetts, United States of America.
Patty Manning-CourtneyUniversity of Cincinnati, Department of Pediatrics, Cincinnati, Ohio, United States of America.
Julie BickelBoston Children's Hospital, Pediatrics, Boston, Massachusetts, United States of America.
Leah Wildenger WelchonsBoston Children's Hospital, Pediatrics, Boston, Massachusetts, United States of America.
Judy ReinholdUniversity of Cincinnati, Department of Pediatrics, Cincinnati, Ohio, United States of America.
Nicole BingUniversity of Cincinnati, Department of Pediatrics, Cincinnati, Ohio, United States of America.
Yizhao NiCincinnati Children's Hospital Medical Center, Division of Biomedical Informatics, Cincinnati, Ohio, United States of America.
William BarbaresiChildren's Hospital Boston, Division of Medicine, Boston, Massachusetts, United States of America.
Frank MentchChildren's Hospital of Philadelphia, Center for Applied Genomics, Philadelphia, Pennsylvania, United States of America.
Melissa BasfordVanderbilt University Medical Center, Vanderbilt Institute for Clinical and Translational Research, Nashville, Tennessee, United States of America.
Joshua DennyVanderbilt University School of Medicine, Biomedical Informatics, Nashville, Tennessee, United States of America.
Lyam VazquezChildren's Hospital of Philadelphia, Center for Applied Genomics, Philadelphia, Pennsylvania, United States of America.
Cassandra PerryBoston Children's Hospital, Division of Genetics and Genomics, Boston, Massachusetts, United States of America.
Bahram NamjouCincinnati Children's Hospital Medical Center, Center for Autoimmune Genomics and Etiology, Cincinnati, Ohio, United States of America.
Haijun QiuChildren's Hospital of Philadelphia, Center for Applied Genomics, Philadelphia, Pennsylvania, United States of America.
John ConnollyChildren's Hospital of Philadelphia, Center for Applied Genomics, Philadelphia, Pennsylvania, United States of America.
Debra AbramsChildren's Hospital of Philadelphia, Center for Applied Genomics, Philadelphia, Pennsylvania, United States of America.
Ingrid A HolmChildren's Hospital Boston, Division of Medicine, Boston, Massachusetts, United States of America.
Beth A CobbCincinnati Children's Hospital Medical Center, Center for Autoimmune Genomics and Etiology, Cincinnati, Ohio, United States of America.
Nataline LingrenCincinnati Children's Hospital Medical Center, Emergency Medicine, Cincinnati, Ohio, United States of America.
Imre SoltiCincinnati Children's Hospital Medical Center, Division of Biomedical Informatics, Cincinnati, Ohio, United States of America.
Hakon HakonarsonChildren's Hospital of Philadelphia, Center for Applied Genomics, Philadelphia, Pennsylvania, United States of America.
Isaac S KohaneHarvard Medical School, Pediatrics, Boston, Massachusetts, United States of America.
John HarleyUniversity of Cincinnati, Department of Pediatrics, Cincinnati, Ohio, United States of America.
Guergana SavovaHarvard Medical School, Pediatrics, Boston, Massachusetts, United States of America.
Cincinnati Children's Hospital Medical Center · USBoston Children's Hospital · USChildren's Hospital of Philadelphia · USVanderbilt University · USHarvard University · USVanderbilt University Medical Center · US

Funding

Translational Research Support CoreP30ES013508 · NIEHS · UNIVERSITY OF PENNSYLVANIA · PI Rebecca A Simmons · 2006 to 2026
$35.3M
The Electronic Medical Records and Genomics (eMERGE) Network Phase III Coordinating Center (U01)U01HG008701 · NHGRI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI PETERSON, JOSEPH F. · 2015 to 2019
$7.1M
The Intellectual and Developmental Disabilities Research Center at CHOP/PennU54HD086984 · NICHD · CHILDREN'S HOSP OF PHILADELPHIA · PI YUDKOFF, MARC · 2016 to 2020
$6.3M
The Future of Genomics Medicine in Patient Care: Contributions from CHOPU01HG008684 · NHGRI · CHILDREN'S HOSP OF PHILADELPHIA · PI HAKONARSON, HAKON · 2015 to 2019
$5.0M
Better Outcomes for Children: Promoting Excellence in Healthcare Genomics to Inform PolicyU01HG008666 · NHGRI · CINCINNATI CHILDRENS HOSP MED CTR · PI HARLEY, JOHN BARKER · 2015 to 2019
$4.2M
Vanderbilt Genome Electronic Records ProjectU01HG006378 · NHGRI · VANDERBILT UNIVERSITY · PI RODEN, DAN M · 2011 to 2014
$4.0M
Better Outcomes for Children: GWAS & PheWAS in eMERGEII.U01HG006828 · NHGRI · CINCINNATI CHILDRENS HOSP MED CTR · PI HARLEY, JOHN BARKER, HOLM, INGRID ADELE · 2012 to 2014
$4.0M
Integrative Analysis of a GWAS Repository with EMRs from over 40,000 ChildrenU01HG006830 · NHGRI · CHILDREN'S HOSP OF PHILADELPHIA · PI HAKONARSON, HAKON · 2012 to 2014
$3.7M
NHGRI NIH HHS U01 HG006378NHGRI NIH HHS U01 HG006828NHGRI NIH HHS U01 HG006830NHGRI NIH HHS U01 HG008666NHGRI NIH HHS U01 HG008684NHGRI NIH HHS U01 HG008701NICHD NIH HHS U54 HD086984NIEHS NIH HHS P30 ES013508
6 · The paper itself

Abstract

objectiveCohort selection is challenging for large-scale electronic health record (EHR) analyses, as International Classification of Diseases 9th edition (ICD-9) diagnostic codes are notoriously unreliable disease predictors. Our objective was to develop, evaluate, and validate an automated algorithm for determining an Autism Spectrum Disorder (ASD) patient cohort from EHR. We demonstrate its utility via the largest investigation to date of the co-occurrence patterns of medical comorbidities in ASD.

methodsWe extracted ICD-9 codes and concepts derived from the clinical notes. A gold standard patient set was labeled by clinicians at Boston Children's Hospital (BCH) (N = 150) and Cincinnati Children's Hospital and Medical Center (CCHMC) (N = 152). Two algorithms were created: (1) rule-based implementing the ASD criteria from Diagnostic and Statistical Manual of Mental Diseases 4th edition, (2) predictive classifier. The positive predictive values (PPV) achieved by these algorithms were compared to an ICD-9 code baseline. We clustered the patients based on grouped ICD-9 codes and evaluated subgroups.

resultsThe rule-based algorithm produced the best PPV: (a) BCH: 0.885 vs. 0.273 (baseline); (b) CCHMC: 0.840 vs. 0.645 (baseline); (c) combined: 0.864 vs. 0.460 (baseline). A validation at Children's Hospital of Philadelphia yielded 0.848 (PPV). Clustering analyses of comorbidities on the three-site large cohort (N = 20,658 ASD patients) identified psychiatric, developmental, and seizure disorder clusters.

conclusionsIn a large cross-institutional cohort, co-occurrence patterns of comorbidities in ASDs provide further hypothetical evidence for distinct courses in ASD. The proposed automated algorithms for cohort selection open avenues for other large-scale EHR studies and individualized treatment of ASD.

Indexed as

AlgorithmsElectronic Health RecordsAutism Spectrum DisorderChildChild, PreschoolCohort StudiesFemaleHumansMale

Identifiers

PMID27472449
PMCPMC4966969
OpenAlexW2488962145

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.