ArticleAmerican journal of epidemiology2008
Evaluation of the potential excess of statistically significant findings in published genetic association studies: application to Alzheimer's disease.
Article in American journal of epidemiology, 2008. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 9 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
24 citing papers in PubMed, 9 syntheses or guidelines pooled it.
- Effectiveness of Violence Prevention Interventions: Umbrella Review of Research in the General Population.Trauma, violence & abuse · 2024Pooled it
- Gut microbiota-derived metabolite trimethylamine-N-oxide and multiple health outcomes: an umbrella review and updated meta-analysis.The American journal of clinical nutrition · 2022Pooled it
- Long-term outcomes of childhood sexual abuse: an umbrella review.The lancet. Psychiatry · 2019Pooled it
- Risk factors for interpersonal violence: an umbrella review of meta-analyses.The British journal of psychiatry : the journal of mental science · 2018Pooled it
- A systematic review and integrative approach to decode the common molecular link between levodopa response and Parkinson's disease.BMC medical genomics · 2017Pooled it
- Vitamin D and multiple health outcomes: umbrella review of systematic reviews and meta-analyses of observational studies and randomised trials.BMJ (Clinical research ed.) · 2014Pooled it
- Potential reporting bias in fMRI studies of the brain.PloS one · 2013Pooled it
- Clinical outcome prediction by microRNAs in human cancer: a systematic review.Journal of the National Cancer Institute · 2012Pooled it
- Collaborative meta-analysis: associations of 150 candidate genes with osteoporosis and osteoporotic fracture.Annals of internal medicine · 2009Pooled it
- Internal consistency of the pediatric daytime sleepiness scale: a meta-analysis across diverse populations.Sleep and biological rhythms · 2025Review
- Schizophrenia in the genetic era: a review from development history, clinical features and genomic research approaches to insights of susceptibility genes.Metabolic brain disease · 2024Review
- The Progress of Multi-Omics Technologies: Determining Function in Lactic Acid Bacteria Using a Systems Level Approach.Frontiers in microbiology · 2019Review
- Examining reproducibility in psychology: A hybrid method for combining a statistically significant original study and a replication.Behavior research methods · 2018Article
- Sensorimotor Learning: Neurocognitive Mechanisms and Individual Differences.Journal of neuroengineering and rehabilitation · 2017Review
- A test for reporting bias in trial networks: simulation and case studies.BMC medical research methodology · 2014Article
- Evaluation of excess significance bias in animal studies of neurological diseases.PLoS biology · 2013Article
- Distinguishing true from false positives in genomic studies: p values.European journal of epidemiology · 2013Article
- Quantifying selective reporting and the Proteus phenomenon for multiple datasets with similar bias.PloS one · 2011Article
- CYP2D6 inhibition and breast cancer recurrence in a population-based study in Denmark.Journal of the National Cancer Institute · 2011Article
- An interactive effect of batch size and composition contributes to discordant results in GWAS with the CHIAMO genotyping algorithm.The pharmacogenomics journal · 2010Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
Abstract
The authors evaluated whether there is an excess of statistically significant results in studies of genetic associations with Alzheimer's disease reflecting either between-study heterogeneity or bias. Among published articles on genetic associations entered into the comprehensive AlzGene database (www.alzgene.org) through January 31, 2007, 1,348 studies included in 175 meta-analyses with 3 or more studies each were analyzed. The number of observed studies (O) with statistically significant results (P = 0.05 threshold) was compared with the expected number (E) under different assumptions for the magnitude of the effect size. In the main analysis, the plausible effect size of each association was the summary effect presented in the respective meta-analysis. Overall, 19 meta-analyses (all with eventually nonsignificant summary effects) had a documented excess of O over E: Typically single studies had significant effects pointing in opposite directions and early summary effects were dissipated over time. Across the whole domain, O was 235 (17.4%), while E was 164.8 (12.2%) (P < 10(-6)). The excess showed a predilection for meta-analyses with nonsignificant summary effects and between-study heterogeneity. The excess was seen for all levels of statistical significance and also for studies with borderline P values (P = 0.05-0.10). The excess of significant findings may represent significance-chasing biases in a setting of massive testing.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.