Evidence map›Paper›PMID 29531060›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2018

Training replicable predictors in multiple studies.

Prasad Patil, Giovanni Parmigiani

Abstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Observational
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Universal adaptability: Target-independent inference that competes with propensity scoring.Proceedings of the National Academy of Sciences of the United States of America · 2022
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Tree-Weighting for Multi-Study Ensemble Learners.Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing · 2020
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Prasad PatilDepartment of Biostatistics and Computational Biology, Dana-Farber Cancer Institute, Boston, MA 02215.
Giovanni ParmigianiDepartment of Biostatistics and Computational Biology, Dana-Farber Cancer Institute, Boston, MA 02215; gp@jimmy.harvard.edu.ORCID 0000-0002-8783-5961

Funding

VectorP30CA006516 · NCI · DANA-FARBER CANCER INSTITUTE · PI JENNIFER W MACK · 1985 to 2026
$330.6M
Training Grant in Quantitative Sciences for Cancer ResearchT32CA009337 · NCI · HARVARD UNIVERSITY (SCH OF PUBLIC HLTH) · PI QUACKENBUSH, JOHN, TRIPPA, LORENZO · 1986 to 2025
$12.3M
NCI NIH HHS P30 CA006516NCI NIH HHS T32 CA009337
6 · The paper itself

Abstract

This article considers replicability of the performance of predictors across studies. We suggest a general approach to investigating this issue, based on ensembles of prediction models trained on different studies. We quantify how the common practice of training on a single study accounts in part for the observed challenges in replicability of prediction performance. We also investigate whether ensembles of predictors trained on multiple studies can be combined, using unique criteria, to design robust ensemble learners trained upfront to incorporate replicability into different contexts and populations.

Indexed as

Machine LearningBiomedical ResearchComputer SimulationDatabases, FactualFemaleHumansOvarian NeoplasmsPrognosisReproducibility of Resultscross-study validationensemble learningmachine learningreplicabilityvalidation

Identifiers

PMID29531060
PMCPMC5856504

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.