Evidence map›Paper›PMID 26820188›Full record

ArticleJournal of biomedical informatics2016

Multivariate analysis of the population representativeness of related clinical studies.

Zhe He, Patrick Ryan, Julia Hoxha, Shuang Wang, Simona Carini, Ida Sim, Chunhua Weng

Open access · greenAbstract read
In one paragraph

Article in Journal of biomedical informatics, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
13.8field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it, 23 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Novel stepwise approach to assess representativeness of a large multicenter observational cohort of tuberculosis patients: The example of RePORT Brazil.International journal of infectious diseases : IJID : official publication of the International Society for Infectious Diseases · 2021
    Observational
  7. Article
  8. Assessing the Use and Perception of Dietary Supplements Among Obese Patients with National Health and Nutrition Examination Survey.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  9. Review
  10. Article
  11. Assessing the Validity of aAMIA ... Annual Symposium proceedings. AMIA Symposium · 2019
    Article
  12. Article
  13. The representativeness of eligible patients in type 2 diabetes trials: a case study using GIST 2.0.Journal of the American Medical Informatics Association : JAMIA · 2018
    Article
  14. Article
  15. Article
  16. Article
  17. Assessing the population representativeness of colorectal cancer treatment clinical trials.Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference · 2016
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 3 institutions in 1 country.

Zhe HeDepartment of Biomedical Informatics, Columbia University, New York, NY 10032, USA. Electronic address: zh2132@columbia.edu.
Patrick RyanDepartment of Biomedical Informatics, Columbia University, New York, NY 10032, USA; Janssen Research and Development, Titusville, NJ 08560, USA; Observational Health Data Sciences and Informatics, New York, NY 10032, USA.
Julia HoxhaDepartment of Biomedical Informatics, Columbia University, New York, NY 10032, USA.
Shuang WangDepartment of Biostatistics, Columbia University, New York, NY 10032, USA.
Simona CariniDepartment of Medicine, University of California, San Francisco, CA 94143, USA.
Ida SimDepartment of Medicine, University of California, San Francisco, CA 94143, USA.
Chunhua WengDepartment of Biomedical Informatics, Columbia University, New York, NY 10032, USA; Observational Health Data Sciences and Informatics, New York, NY 10032, USA.
Columbia University · USUniversity of California, San Francisco · USJanssen (United States) · US

Funding

Clinical and Translational Science AwardUL1TR000040 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2012 to 2015
$26.2M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
NCATS NIH HHS UL1 TR000040NCATS NIH HHS UL1TR000040NLM NIH HHS R01 LM009886NLM NIH HHS R01LM009886
6 · The paper itself

Abstract

objectiveTo develop a multivariate method for quantifying the population representativeness across related clinical studies and a computational method for identifying and characterizing underrepresented subgroups in clinical studies.

methodsWe extended a published metric named Generalizability Index for Study Traits (GIST) to include multiple study traits for quantifying the population representativeness of a set of related studies by assuming the independence and equal importance among all study traits. On this basis, we compared the effectiveness of GIST and multivariate GIST (mGIST) qualitatively. We further developed an algorithm called "Multivariate Underrepresented Subgroup Identification" (MAGIC) for constructing optimal combinations of distinct value intervals of multiple traits to define underrepresented subgroups in a set of related studies. Using Type 2 diabetes mellitus (T2DM) as an example, we identified and extracted frequently used quantitative eligibility criteria variables in a set of clinical studies. We profiled the T2DM target population using the National Health and Nutrition Examination Survey (NHANES) data.

resultsAccording to the mGIST scores for four example variables, i.e., age, HbA1c, BMI, and gender, the included observational T2DM studies had superior population representativeness than the interventional T2DM studies. For the interventional T2DM studies, Phase I trials had better population representativeness than Phase III trials. People at least 65years old with HbA1c value between 5.7% and 7.2% were particularly underrepresented in the included T2DM trials. These results confirmed well-known knowledge and demonstrated the effectiveness of our methods in population representativeness assessment.

conclusionsmGIST is effective at quantifying population representativeness of related clinical studies using multiple numeric study traits. MAGIC identifies underrepresented subgroups in clinical studies. Both data-driven methods can be used to improve the transparency of design bias in participation selection at the research community level.

Indexed as

AlgorithmsSelection BiasBiomedical ResearchClinical Trials as TopicDatabases, FactualDemographyDiabetes Mellitus, Type 2HumansMedical Informatics ComputingMultivariate AnalysisNutrition SurveysObservational Studies as TopicPatient SelectionClinical trialKnowledge representationSelection bias

Identifiers

PMID26820188
PMCPMC4837055
OpenAlexW2280473949

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.