Evidence map›Paper›PMID 34294901›Full record

ReviewNature human behaviour2021

Behavioural science is unlikely to change the world without a heterogeneity revolution.

Christopher J Bryan, Elizabeth Tipton, David S Yeager

Registry-linked trialAbstract readReview
In one paragraph

Review in Nature human behaviour, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06792461 (A Randomized Controlled Trial to Evaluate the Implementation of an eHealth Platform for Promoting Healthy Habits Among Adolescents From Socially Disadvantaged Settings), which is not on this map. Cited by 119 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
119citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06792461 narecruitingnot on this mapstarted 2025, after this paper: background citation

A Randomized Controlled Trial to Evaluate the Implementation of an eHealth Platform for Promoting Healthy Habits Among Adolescents From Socially Disadvantaged Settings: the ePro-Schools Project

TypeinterventionalSponsorFundació Sant Joan de DéuRan2025 to 2027Enrolled1,000ConditionsHealth Promotion, Health Education, Physical Activity, NutritionArmsPhysical activity and nutritional behavioural intervention
3 · Its place in the literature

Who cites it

119 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Prevalence and predictors of medical information avoidance: a systematic review and meta-analysis.Annals of behavioral medicine : a publication of the Society of Behavioral Medicine · 2025
    Pooled it
  4. Pooled it
  5. The effectiveness of nudging: A meta-analysis of choice architecture interventions across behavioral domains.Proceedings of the National Academy of Sciences of the United States of America · 2022
    Pooled it
  6. Trial
  7. A prosocial value intervention in gateway STEM courses.Journal of personality and social psychology · 2023
    Trial
  8. Trial
  9. Trial
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

59 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Christopher J BryanUniversity of Texas at Austin, Austin, TX, USA. christopher.bryan@mccombs.utexas.edu.ORCID http://orcid.org/0000-0002-1582-4411
Elizabeth TiptonNorthwestern University, Evanston, IL, USA. tipton@northwestern.edu.ORCID http://orcid.org/0000-0001-5608-1282
David S YeagerUniversity of Texas at Austin, Austin, TX, USA. dyeager@utexas.edu.ORCID http://orcid.org/0000-0002-8522-9503

Funding

Scientific & Technical CoreP2CHD042849 · NICHD · UNIVERSITY OF TEXAS AT AUSTIN · PI Elizabeth T. Gershoff · 2017 to 2026
$5.2M
NICHD NIH HHS P2C HD042849
6 · The paper itself

Abstract

In the past decade, behavioural science has gained influence in policymaking but suffered a crisis of confidence in the replicability of its findings. Here, we describe a nascent heterogeneity revolution that we believe these twin historical trends have triggered. This revolution will be defined by the recognition that most treatment effects are heterogeneous, so the variation in effect estimates across studies that defines the replication crisis is to be expected as long as heterogeneous effects are studied without a systematic approach to sampling and moderation. When studied systematically, heterogeneity can be leveraged to build more complete theories of causal mechanism that could inform nuanced and dependable guidance to policymakers. We recommend investment in shared research infrastructure to make it feasible to study behavioural interventions in heterogeneous and generalizable samples, and suggest low-cost steps researchers can take immediately to avoid being misled by heterogeneity and begin to learn from it instead.

Indexed as

Behavioral SciencesPolicy MakingReproducibility of ResultsResearch DesignArtificial IntelligenceBehavior ControlCausalityHumansScientific Experimental Error

Identifiers

PMID34294901
PMCPMC8928154

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.