Evidence map›Paper›PMID 25024761›Full record

ArticleApplied clinical informatics2014

A distribution-based method for assessing the differences between clinical trial target populations and patient populations in electronic health records.

C Weng, Y Li, P Ryan, Y Zhang, F Liu, J Gao, J T Bigger, G Hripcsak

Abstract read
In one paragraph

Article in Applied clinical informatics, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 42 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
42citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

42 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations.International journal of environmental research and public health · 2020
    Pooled it
  2. Pooled it
  3. Characterizing treatment pathways at scale using the OHDSI network.Proceedings of the National Academy of Sciences of the United States of America · 2016
    Pooled it
  4. Visualizing Baseline Eligibility Across Locally Advanced or Metastatic Urothelial Cancer Trials and Real-World Cohorts.International journal of urology : official journal of the Japanese Urological Association · 2026
    Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
  12. A knowledge base of clinical trial eligibility criteria.Journal of biomedical informatics · 2021
    Article
  13. Contemporary use of real-world data for clinical trial conduct in the United States: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2021
    Article
  14. Article
  15. Assessing the Use and Perception of Dietary Supplements Among Obese Patients with National Health and Nutrition Examination Survey.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  16. Review
  17. Article
  18. Article
  19. Learning Personalized Treatment Rules from Electronic Health Records Using Topic Modeling Feature Extraction.Proceedings of the ... International Conference on Data Science and Advanced Analytics. IEEE International Conference on Data Science and Advanced Analytics · 2019
    Article
  20. An outcome model approach to transporting a randomized controlled trial results to a target population.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

C WengDepartment of Biomedical Informatics, Columbia University , New York, NY 10032.
Y LiDepartment of Computer Science, City College of New York , New York, NY 10031.
P RyanJanssen Research and Development , Titusville, New Jersey, 08560 ; Observational Health Data Sciences and Informatics , New York, NY, 10032.
Y ZhangDepartment of Biostatistics, Columbia University , New York, NY 10032.
F LiuDepartment of Biomedical Informatics, Columbia University , New York, NY 10032.
J GaoBusiness School, Columbia University , New York, NY 10025.
J T BiggerDepartment of Medicine, Columbia University , New York, NY 10032.
G HripcsakDepartment of Biomedical Informatics, Columbia University , New York, NY 10032.

Funding

Clinical and Translational Science AwardUL1TR000040 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2012 to 2015
$26.2M
DISCOVERING AND APPLYING KNOWLEDGE IN CLINICAL DATABASESR01LM006910 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI HRIPCSAK, GEORGE M · 2000 to 2023
$10.6M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
Developing Flexible EHR Plug-ins to Re-Engineer Clinical Care and Research WorkflowsR01LM010815 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI HOMMA, SHUNICHI, WENG, CHUNHUA · 2010 to 2013
$1.9M
NCATS NIH HHS UL1 TR000040NCATS NIH HHS UL1TR000040NLM NIH HHS R01 LM006910NLM NIH HHS R01LM006910NLM NIH HHS R01 LM009886NLM NIH HHS R01LM009886NLM NIH HHS R01 LM010815NLM NIH HHS R01LM010815
6 · The paper itself

Abstract

objectiveTo improve the transparency of clinical trial generalizability and to illustrate the method using Type 2 diabetes as an example.

methodsOur data included 1,761 diabetes clinical trials and the electronic health records (EHR) of 26,120 patients with Type 2 diabetes who visited Columbia University Medical Center of New-York Presbyterian Hospital. The two populations were compared using the Generalizability Index for Study Traits (GIST) on the earliest diagnosis age and the mean hemoglobin A1c (HbA1c) values.

resultsGreater than 70% of Type 2 diabetes studies allow patients with HbA1c measures between 7 and 10.5, but less than 40% of studies allow HbA1c<7 and fewer than 45% of studies allow HbA1c>10.5. In the real-world population, only 38% of patients had HbA1c between 7 and 10.5, with 12% having values above the range and 52% having HbA1c<7. The GIST for HbA1c was 0.51. Most studies adopted broad age value ranges, with the most common restrictions excluding patients >80 or <18 years. Most of the real-world population fell within this range, but 2% of patients were <18 at time of first diagnosis and 8% were >80. The GIST for age was 0.75.

conclusionsWe contribute a scalable method to profile and compare aggregated clinical trial target populations with EHR patient populations. We demonstrate that Type 2 diabetes studies are more generalizable with regard to age than they are with regard to HbA1c. We found that the generalizability of age increased from Phase 1 to Phase 3 while the generalizability of HbA1c decreased during those same phases. This method can generalize to other medical conditions and other continuous or binary variables. We envision the potential use of EHR data for examining the generalizability of clinical trials and for defining population-representative clinical trial eligibility criteria.

Indexed as

Electronic Health RecordsPatient SelectionAcademic Medical CentersAge DistributionClinical Trials as TopicDiabetes Mellitus, Type 2Eligibility DeterminationFemaleGlycated HemoglobinHumansInformation Storage and RetrievalInpatientsInternetMaleMiddle AgedOutpatientsGlycated Hemoglobinclinical research informaticsClinical trialscomparative effectiveness researchelectronic health recordsmeta-analysisselection bias

Identifiers

PMID25024761
PMCPMC4081748

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.