Evidence map›Paper›PMID 33914579›Full record

ArticlePsychology and aging2022

Data overuse in aging research: Emerging issues and potential solutions.

Daniel K Mroczek, Sara J Weston, Eileen K Graham, Emily C Willroth

Abstract read
In one paragraph

Article in Psychology and aging, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. A Taxonomy of Data Synthesis.Personality & social psychology bulletin · 2026
    Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. A Coordinated Data Analysis of Four Studies Exploring Age Differences in Social Interactions and Loneliness During a Global Pandemic.The journals of gerontology. Series B, Psychological sciences and social sciences · 2024
    Article
  11. Article
  12. Article
  13. Article
  14. Global rural health disparities in Alzheimer's disease and related dementias: State of the science.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2023
    Review
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Daniel K MroczekDepartment of Medical Social Sciences, Feinberg School of Medicine, Northwestern University.ORCID 0000-0003-3748-5059
Sara J WestonDepartment of Psychology, University of Oregon.ORCID 0000-0001-7782-6239
Eileen K GrahamDepartment of Medical Social Sciences, Feinberg School of Medicine, Northwestern University.ORCID 0000-0003-3095-4625
Emily C WillrothDepartment of Medical Social Sciences, Feinberg School of Medicine, Northwestern University.

Funding

PERSONALITY AND WELL BEING TRAJECTORIES IN ADULTHOODR01AG018436 · NIA · PURDUE UNIVERSITY WEST LAFAYETTE · PI MROCZEK, DANIEL K. · 2000 to 2020
$6.7M
Boston Early Adversity and Mortality Study (BEAMS): Linking Administrative Data to Long-Term Longitudinal StudiesRF1AG064006 · NIA · NORTHWESTERN UNIVERSITY AT CHICAGO · PI LEE, LEWINA ONYI, MROCZEK, DANIEL K. · 2019 to 2023
$3.8M
Personality prediction of dementia risk and progressionR01AG067622 · NIA · NORTHWESTERN UNIVERSITY AT CHICAGO · PI MROCZEK, DANIEL K. · 2019 to 2023
$3.2M
NIA NIH HHSNIA NIH HHS R01 AG018436NIA NIH HHS R01 AG067622NIA NIH HHS RF1 AG064006
6 · The paper itself

Abstract

Aging and lifespan development researchers have been fortunate to have public access to many longitudinal datasets. These data are valuable and see high utilization, yet this has a considerable downside. Many of these are heavily overused. Overuse of publicly available datasets creates dependency among published research papers giving the false impression of independent contributions to knowledge by reporting the same associations over multiple papers. This is a potentially serious problem in the aging literature given the high use of a relatively small number of well-known studies. Any irregularities or sampling biases in this relatively small number of samples have outsize influence on perceived answers to key aging questions. We detail this problem, focusing on issues of dependency among studies, sampling bias and overfitting, and contradictory estimates of the same effect from the same data in independent publications. We provide solutions, including greater use of data sharing, pre-registrations, holdout samples, split-sample cross-validation, and coordinated analysis. We argue these valuable datasets are public resources that are being diminished by overuse, with parallels in environmental science. Taking a conservation perspective, we hold that these practices (pre-registration, holdout samples) can preserve data resources for future generations of researchers. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Indexed as

AgingGeroscienceHumansResearch Design

Identifiers

PMID33914579
PMCPMC8553804

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.