Evidence map›Paper›PMID 25027274›Full record

ArticleBiostatistics (Oxford, England)2015

Testing calibration of risk models at extremes of disease risk.

Minsun Song, Peter Kraft, Amit D Joshi, Myrto Barrdahl, Nilanjan Chatterjee

Abstract read
In one paragraph

Article in Biostatistics (Oxford, England), 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Minsun SongDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD 20850, USA.
Peter KraftDepartment of Epidemiology, Harvard School of Public Health, Boston, MA 02115, USA.
Amit D JoshiDepartment of Epidemiology, Harvard School of Public Health, Boston, MA 02115, USA.
Myrto BarrdahlDivision of Cancer Epidemiology, German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany.
Nilanjan ChatterjeeDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD 20850, USA chattern@mail.nih.gov.

Funding

Methods for Epidemiology StudiesZIACP010181 · NCI · DIVISION OF CANCER EPIDEMIOLOGY AND GENETICS · PI ALBERT, PAUL · 2009 to 2025
$34.8M
Characterizing Genetic Susceptibility to Breast and Prostate Cancer; the BPC3U01CA098758 · NCI · UNIVERSITY OF SOUTHERN CALIFORNIA · PI HENDERSON, BRIAN E · 2003 to 2010
$11.0M
Characterizing Genetic Susceptibility to Breast and Prostate Cancer; the BPC3U01CA098233 · NCI · BRIGHAM AND WOMEN'S HOSPITAL · PI HUNTER, DAVID JOHN · 2003 to 2010
$10.8M
Epidemiologic StudiesU19CA148065 · NCI · HARVARD SCHOOL OF PUBLIC HEALTH · PI AHSAN, HABIBUL, BRUGGE, JOAN SIEFERT · 2010 to 2014
$10.6M
Characterizing Genetic Susceptibility to Breast and Prostate Cancer; the BPC3U01CA098216 · NCI · INTERNATIONAL AGENCY FOR RES ON CANCER · PI RIBOLI, ELIO · 2003 to 2011
$7.4M
Characterizing Genetic Susceptibility to Breast and Prostate Cancer: The BPC3.U01CA098710 · NCI · AMERICAN CANCER SOCIETY, INC. · PI GAPSTUR, SUSAN M · 2003 to 2011
$4.2M
Improving Polygenic Prediction using Next-Generation Data SetsR01GM105857 · NIGMS · BRIGHAM AND WOMEN'S HOSPITAL · PI SUNYAEV, SHAMIL · 2014 to 2017
$2.0M
Intramural NIH HHSNCI NIH HHS U01 CA098216NCI NIH HHS U01 CA098233NCI NIH HHS U01 CA098710NCI NIH HHS U01 CA098758NCI NIH HHS U01-CA98216NCI NIH HHS U01-CA98233NCI NIH HHS U01-CA98710NCI NIH HHS U01-CA98758NCI NIH HHS U19 CA148065NCI NIH HHS U19-CA148065NIGMS NIH HHS R01 GM105857
6 · The paper itself

Abstract

Risk-prediction models need careful calibration to ensure they produce unbiased estimates of risk for subjects in the underlying population given their risk-factor profiles. As subjects with extreme high or low risk may be the most affected by knowledge of their risk estimates, checking the adequacy of risk models at the extremes of risk is very important for clinical applications. We propose a new approach to test model calibration targeted toward extremes of disease risk distribution where standard goodness-of-fit tests may lack power due to sparseness of data. We construct a test statistic based on model residuals summed over only those individuals who pass high and/or low risk thresholds and then maximize the test statistic over different risk thresholds. We derive an asymptotic distribution for the max-test statistic based on analytic derivation of the variance-covariance function of the underlying Gaussian process. The method is applied to a large case-control study of breast cancer to examine joint effects of common single nucleotide polymorphisms (SNPs) discovered through recent genome-wide association studies. The analysis clearly indicates a non-additive effect of the SNPs on the scale of absolute risk, but an excellent fit for the linear-logistic model even at the extremes of risks.

Indexed as

Genetic Predisposition to DiseaseModels, GeneticModels, StatisticalBreast NeoplasmsCalibrationGenome-Wide Association StudyHumansRisk AssessmentCase–control studiesGene–gene and gene–environment interactionsGenome-wide association studiesGoodness-of-fit testsPolygenic scoreRisk stratification

Identifiers

PMID25027274
PMCPMC4263225

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.