Evidence map›Paper›PMID 30590688›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2019

Enrichment sampling for a multi-site patient survey using electronic health records and census data.

Nathaniel D Mercaldo, Kyle B Brothers, David S Carrell, Ellen W Clayton, John J Connolly, Ingrid A Holm, Carol R Horowitz, Gail P Jarvik, Terrie E Kitchner, Rongling Li and 10 more

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. The journey to transparency, reproducibility, and replicability.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

20 authors.

Nathaniel D MercaldoDepartment of Radiology, Institute for Technology Assessment, Massachusetts General Hospital, Boston, Massachusetts, USA.
Kyle B BrothersDepartment of Pediatrics, University of Louisville, Louisville, Kentucky, USA.
David S CarrellKaiser Permanente Washington Health Research Institute, Seattle, Washington, USA.
Ellen W ClaytonCenter for Biomedical Ethics and Society, Vanderbilt University, Nashville, Tennessee, USA.
John J ConnollyCenter for Applied Genomics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA.
Ingrid A HolmDivision of Genetics and Genomics, Boston Children's Hospital, Boston, Massachusetts, USA.
Carol R HorowitzDepartment of Population Health Science and Policy, Ichan School of Medicine at Mt. Sinai, New York, New York, USA.
Gail P JarvikDepartment of Genome Sciences, University of Washington, Seattle, Washington, USA.
Terrie E KitchnerCenter for Human Genetics, Marshfield Clinic Research Foundation, Marshfield, Wisconsin, USA.
Rongling LiDivision of Genomic Medicine, National Human Genome Research Institute, Bethesda, Maryland, USA.
Catherine A McCartyDepartment of Family Medicine and Biobehavioral Health, University of Minnesota Medical School, Duluth, Minnesota, USA.
Jennifer B McCormickBiomedical Ethics Program, Mayo Clinic, Rochester, Minnesota, USA.
Valerie D McManusBiomedical Informatics Research Center, Marshfield Clinic Research Foundation, Marshfield, Wisconsin, USA.
Melanie F MyersDivision of Human Genetics, Cincinnati Children's Hospital, College of Medicine, University of Cincinnati, Cincinnati, Ohio, USA.
Joshua J PankratzDepartment of Information Technology, Mayo Clinic, Rochester, Minnesota, USA.
Martha J ShrubsoleVanderbilt Epidemiology Center, Vanderbilt University, Nashville, Tennessee, USA.
Maureen E SmithCenter for Genetic Medicine, Northwestern University, Chicago, Illinois, USA.
Sarah C StallingsDivision of Geriatric Medicine, Vanderbilt University, Nashville, Tennessee, USA.
Janet L WilliamsGenomic Medicine Institute, Geisinger, Danville, Pennsylvania, USA.
Jonathan S SchildcroutDepartment of Biostatistics, Vanderbilt University, Nashville, Tennessee, USA.

Funding

Genomic Basis of Susceptibility to COVID-19 Infection and its ComplicationsU01HG006379 · NHGRI · MAYO CLINIC ROCHESTER · PI Richard R. Sharp · 2011 to 2026
$16.5M
Outcome Dependent Sampling Studies of Longitudinal Data: Design and AnalysisR01HL094786 · NHLBI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI Jonathan Scott Schildcrout · 2009 to 2026
$6.1M
eMERGE Coordinating Center - Administrative SupplementU01HG006385 · NHGRI · VANDERBILT UNIVERSITY · PI HARRIS, PAUL A. · 2011 to 2014
$5.4M
Biorepository for Genomic Medicine in diverse CommunitiesU01HG006380 · NHGRI · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI BOTTINGER, ERWIN P. · 2011 to 2015
$4.5M
Geisinger eGenonic Medicine (GeM) ProgramU01HG006382 · NHGRI · GEISINGER CLINIC · PI CAREY, DAVID J., WILLIAMS, MARC S. · 2011 to 2014
$4.3M
A Personalized Genomic Medicine Pilot Program Using the NJgene eMERGE ExperienceU01HG006388 · NHGRI · NORTHWESTERN UNIVERSITY AT CHICAGO · PI CHISHOLM, REX L, SMITH, MAUREEN E · 2011 to 2014
$4.1M
IRIS: Incorporating Research Into SightU01HG006389 · NHGRI · ESSENTIA INSTITUTE OF RURAL HEALTH · PI MCCARTY, CATHERINE ANNE · 2011 to 2014
$4.1M
Genetic Discovery and Application in a Clinical Setting Continuing a PartnershipU01HG006375 · NHGRI · KAISER FOUNDATION HEALTH PLAN OF WASHINGTON · PI JARVIK, GAIL PAIRITZ, LARSON, ERIC B · 2011 to 2014
$4.1M
Vanderbilt Genome Electronic Records ProjectU01HG006378 · NHGRI · VANDERBILT UNIVERSITY · PI RODEN, DAN M · 2011 to 2014
$4.0M
Better Outcomes for Children: GWAS & PheWAS in eMERGEII.U01HG006828 · NHGRI · CINCINNATI CHILDRENS HOSP MED CTR · PI HARLEY, JOHN BARKER, HOLM, INGRID ADELE · 2012 to 2014
$4.0M
Integrative Analysis of a GWAS Repository with EMRs from over 40,000 ChildrenU01HG006830 · NHGRI · CHILDREN'S HOSP OF PHILADELPHIA · PI HAKONARSON, HAKON · 2012 to 2014
$3.7M
NHGRI NIH HHS U01 HG006375NHGRI NIH HHS U01 HG006378NHGRI NIH HHS U01 HG006379NHGRI NIH HHS U01 HG006380NHGRI NIH HHS U01 HG006382NHGRI NIH HHS U01 HG006385NHGRI NIH HHS U01 HG006388NHGRI NIH HHS U01 HG006389NHGRI NIH HHS U01 HG006828NHGRI NIH HHS U01 HG006830NHLBI NIH HHS R01 HL094786
6 · The paper itself

Abstract

Objective: We describe a stratified sampling design that combines electronic health records (EHRs) and United States Census (USC) data to construct the sampling frame and an algorithm to enrich the sample with individuals belonging to rarer strata. Materials and Methods: This design was developed for a multi-site survey that sought to examine patient concerns about and barriers to participating in research studies, especially among under-studied populations (eg, minorities, low educational attainment). We defined sampling strata by cross-tabulating several socio-demographic variables obtained from EHR and augmented with census-block-level USC data. We oversampled rarer and historically underrepresented subpopulations. Results: The sampling strategy, which included USC-supplemented EHR data, led to a far more diverse sample than would have been expected under random sampling (eg, 3-, 8-, 7-, and 12-fold increase in African Americans, Asians, Hispanics and those with less than a high school degree, respectively). We observed that our EHR data tended to misclassify minority races more often than majority races, and that non-majority races, Latino ethnicity, younger adult age, lower education, and urban/suburban living were each associated with lower response rates to the mailed surveys. Discussion: We observed substantial enrichment from rarer subpopulations. The magnitude of the enrichment depends on the accuracy of the variables that define the sampling strata and the overall response rate. Conclusion: EHR and USC data may be used to define sampling strata that in turn may be used to enrich the final study sample. This design may be of particular interest for studies of rarer and understudied populations.

Indexed as

CensusesElectronic Health RecordsPatient SelectionSurveys and QuestionnairesAdultAgedAlgorithmsEthnicityFemaleHumansMaleMeaningful UseMiddle AgedMinority GroupsRacial GroupsUnited States

Identifiers

PMID30590688
PMCPMC6351976

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.