Evidence map›Paper›PMID 36738870›Full record

ArticleJournal of biomedical informatics2023

Informative missingness: What can we learn from patterns in missing laboratory data in the electronic health record?

Amelia L M Tan, Emily J Getzen, Meghan R Hutch, Zachary H Strasser, Alba Gutiérrez-Sacristán, Trang T Le, Arianna Dagliati, Michele Morris, David A Hanauer, Bertrand Moal and 30 more

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

40 authors.

Amelia L M TanHarvard Medical School, Cambridge, MA, USA.
Emily J GetzenUniversity of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Meghan R HutchNorthwestern University, Chicago, IL, USA.
Zachary H StrasserMassachusetts General Hospital, Boston, MA, USA.
Alba Gutiérrez-SacristánHarvard Medical School, Cambridge, MA, USA.
Trang T LeUniversity of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Arianna DagliatiUniversity of Pavia, Pavia, Italy.
Michele MorrisUniversity of Pittsburgh, Pittsburgh, PA, USA.
David A HanauerUniversity of Michigan, Ann Arbor, MI, USA.
Bertrand MoalBordeaux University Hospital, Talence, France.
Clara-Lea BonzelHarvard Medical School, Cambridge, MA, USA.
William YuanHarvard Medical School, Cambridge, MA, USA.
Lorenzo ChiudinelliASST Papa Giovanni XXIII, Bergamo, Italy.
Priam DasHarvard Medical School, Cambridge, MA, USA.
Harrison G ZhangHarvard Medical School, Cambridge, MA, USA.
Bruce J AronowCincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, OH, USA.
Paul AvillachHarvard Medical School, Cambridge, MA, USA.
Gabriel A BratHarvard Medical School, Cambridge, MA, USA.
Tianxi CaiHarvard Medical School, Cambridge, MA, USA.
Chuan HongHarvard Medical School, Cambridge, MA, USA; Duke University, Durham, NC, USA.
William G La CavaHarvard Medical School, Cambridge, MA, USA; Boston Children's Hospital, Boston, MA, USA.
He Hooi Will LohNational University Health Systems, Singapore.
Yuan LuoNorthwestern University, Chicago, IL, USA.
Shawn N MurphyMassachusetts General Hospital, Boston, MA, USA.
Kee Yuan HgiamNational University Health Systems, Singapore.
Gilbert S OmennUniversity of Pittsburgh, Pittsburgh, PA, USA.
Lav P PatelUniversity of Kansas Medical Center, United States.
Malarkodi Jebathilagam SamayamuthuUniversity of Pittsburgh, Pittsburgh, PA, USA.
Emily R ShriverUniversity of Pennsylvania Health System, Philadelphia, PA, USA.
Zahra Shakeri Hossein AbadHarvard Medical School, Cambridge, MA, USA.
Byorn W L TanNational University Health Systems, Singapore.
Shyam VisweswaranUniversity of Pittsburgh, Pittsburgh, PA, USA.
Xuan WangHarvard Medical School, Cambridge, MA, USA.
Griffin M WeberHarvard Medical School, Cambridge, MA, USA.
Zongqi XiaUniversity of Pittsburgh, Pittsburgh, PA, USA.
Bertrand VerdyBordeaux University Hospital, Talence, France.
COVID-19 by EHR (4CE)
Qi LongUniversity of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Danielle L MoweryUniversity of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
John H HolmesUniversity of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.

Funding

University of Pittsburgh Clinical and Translational Science InstituteUL1TR001857 · NCATS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E · 2016 to 2025
$129.3M
Phenotypic Diversity in COVID-19UL1TR001878 · NCATS · UNIVERSITY OF PENNSYLVANIA · PI FITZGERALD, GARRET A · 2016 to 2025
$102.4M
The Harvard Clinical and Translational Science CenterUL1TR002541 · NCATS · HARVARD MEDICAL SCHOOL · PI NADLER, LEE MARSHALL · 2018 to 2022
$93.0M
Michigan Institute for Clinical and Health Research (MICHR)UL1TR002240 · NCATS · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI LUMENG, JULIE C, MASHOUR, GEORGE ALEXANDER · 2017 to 2022
$54.9M
University of Pittsburgh Clinical and Translational Science InstituteUL1TR000005 · NCATS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E · 2012 to 2015
$50.8M
RADx-UP: Improving the Response of Local Urban and Rural Communities to Disparities in Covid-19 TestingUL1TR002366 · NCATS · UNIVERSITY OF KANSAS MEDICAL CENTER · PI Mario Castro, JAMES STEVEN LEEDER · 2017 to 2026
$44.3M
Michigan Institute for Clinical and Health Research (MICHR)UM1TR004404 · NCATS · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI Julie C Lumeng · 2023 to 2026
$39.8M
Strategic Vision & Impact on Environmental HealthP30ES017885 · NIEHS · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI Dana Dolinoy · 2011 to 2026
$21.3M
Finding Genomic Profiles of COVID-19 Phenotypes from the EHRU01HG008685 · NHGRI · BRIGHAM AND WOMEN'S HOSPITAL · PI ELIZABETH W KARLSON, Matthew S Lebo · 2015 to 2026
$13.6M
The LungMAP Data Coordination Center for Next Gen Systems Biology of RespirationU24HL148865 · NHLBI · CINCINNATI CHILDRENS HOSP MED CTR · PI Bruce J Aronow, Nathan G. Salomonis · 2019 to 2026
$12.4M
RESEARCH TRAINING IN PEDIATRIC EMERGENCY MEDICINET32HD040128 · NICHD · CHILDREN'S HOSPITAL BOSTON · PI Kenneth D. Mandl · 2001 to 2026
$5.0M
Leveraging electronic health records to optimize treatment selection and response in multiple sclerosisR01NS098023 · NINDS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI Zongqi Xia · 2016 to 2026
$4.6M
NCATS NIH HHS UL1 TR000005NCATS NIH HHS UL1 TR001857NCATS NIH HHS UL1 TR001878NCATS NIH HHS UL1 TR002240NCATS NIH HHS UL1 TR002366NCATS NIH HHS UL1 TR002541NCATS NIH HHS UM1 TR004404NCI NIH HHS U24 CA210967NHGRI NIH HHS R01 HG009174NHGRI NIH HHS U01 HG008685NHLBI NIH HHS L40 HL148910NHLBI NIH HHS U24 HL148865NIA NIH HHS RF1 AG063481NICHD NIH HHS T32 HD040128NIEHS NIH HHS P30 ES017885NIGMS NIH HHS R01 GM124111NINDS NIH HHS R01 NS098023NINDS NIH HHS R01 NS124882NLM NIH HHS R00 LM012926NLM NIH HHS R01 LM013337NLM NIH HHS R01 LM013345
6 · The paper itself

Abstract

backgroundIn electronic health records, patterns of missing laboratory test results could capture patients' course of disease as well as ​​reflect clinician's concerns or worries for possible conditions. These patterns are often understudied and overlooked. This study aims to identify informative patterns of missingness among laboratory data collected across 15 healthcare system sites in three countries for COVID-19 inpatients.

methodsWe collected and analyzed demographic, diagnosis, and laboratory data for 69,939 patients with positive COVID-19 PCR tests across three countries from 1 January 2020 through 30 September 2021. We analyzed missing laboratory measurements across sites, missingness stratification by demographic variables, temporal trends of missingness, correlations between labs based on missingness indicators over time, and clustering of groups of labs based on their missingness/ordering pattern.

resultsWith these analyses, we identified mapping issues faced in seven out of 15 sites. We also identified nuances in data collection and variable definition for the various sites. Temporal trend analyses may support the use of laboratory test result missingness patterns in identifying severe COVID-19 patients. Lastly, using missingness patterns, we determined relationships between various labs that reflect clinical behaviors.

conclusionIn this work, we use computational approaches to relate missingness patterns to hospital treatment capacity and highlight the heterogeneity of looking at COVID-19 over time and at multiple sites, where there might be different phases, policies, etc. Changes in missingness could suggest a change in a patient's condition, and patterns of missingness among laboratory measurements could potentially identify clinical outcomes. This allows sites to consider missing data as informative to analyses and help researchers identify which sites are better poised to study particular questions.

Indexed as

COVID-19Electronic Health RecordsCluster AnalysisData CollectionHumansRecordsCOVID-19Electronic health recordsLaboratory testsMissing dataMulti-site health data

Identifiers

PMID36738870
PMCPMC10849195

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.