Evidence map›Paper›PMID 34880497›Full record

Trial reportNature2021

Megastudies improve the impact of applied behavioural science.

Katherine L Milkman, Dena Gromet, Hung Ho, Joseph S Kay, Timothy W Lee, Pepi Pandiloski, Yeji Park, Aneesh Rai, Max Bazerman, John Beshears and 33 more

Abstract readClinical TrialComparative StudyMulticenter Study
In one paragraph

Trial report in Nature, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 76 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
76citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

76 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2025
    Guideline
  3. Recommendations on interventions for tobacco smoking cessation in adults in Canada.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2025
    Guideline
  4. Pooled it
  5. Pooled it
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Article
  16. Article
  17. Article
  18. Article
  19. Observational
  20. Article

16 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

43 authors.

Katherine L MilkmanDepartment of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA. kmilkman@wharton.upenn.edu.ORCID http://orcid.org/0000-0002-9706-4830
Dena GrometBehavior Change for Good Initiative, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Hung HoDepartment of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Joseph S KayBehavior Change for Good Initiative, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Timothy W LeeBehavior Change for Good Initiative, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Pepi PandiloskiHarris School of Public Policy, University of Chicago, Chicago, IL, USA.
Yeji ParkDepartment of Psychology, Princeton University, Princeton, NJ, USA.
Aneesh RaiDepartment of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0001-9633-2568
Max BazermanDepartment of Negotiation, Organizations & Markets, Harvard Business School, Harvard University, Boston, MA, USA.
John BeshearsDepartment of Negotiation, Organizations & Markets, Harvard Business School, Harvard University, Boston, MA, USA.
Lauri BonacorsiPritzker School of Law, Northwestern University, Chicago, IL, USA.
Colin CamererDivision of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA.
Edward ChangDepartment of Negotiation, Organizations & Markets, Harvard Business School, Harvard University, Boston, MA, USA.ORCID http://orcid.org/0000-0003-0502-2957
Gretchen ChapmanDepartment of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.
Robert CialdiniDepartment of Psychology, Arizona State University, Tempe, AZ, USA.
Hengchen DaiDepartment of Management and Organizations, Anderson School of Management, University of California Los Angeles, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0001-7640-6558
Lauren Eskreis-WinklerDepartment of Behavioral Science, Booth School of Business, University of Chicago, Chicago, IL, USA.
Ayelet FishbachDepartment of Behavioral Science, Booth School of Business, University of Chicago, Chicago, IL, USA.
James J GrossDepartment of Psychology, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0003-3624-3090
Samantha HornDepartment of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.ORCID http://orcid.org/0000-0003-2716-5860
Alexa HubbardDepartment of Psychology, New York University, New York, NY, USA.
Steven J JonesDepartment of Psychology, Rutgers University, New Brunswick, NJ, USA.
Dean KarlanDepartment of Finance, Kellogg School of Management, Northwestern University, Evanston, IL, USA.ORCID http://orcid.org/0000-0003-0164-1398
Tim KautzMathematica, Princeton, NJ, USA.
Erika KirgiosDepartment of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0002-7891-0499
Joowon KlusowskiDepartment of Marketing, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Ariella KristalDepartment of Organizational Behavior, Harvard Business School, Harvard University, Boston, MA, USA.
Rahul LadhaniaDepartment of Health Management and Policy, School of Public Health, University of Michigan, Ann Arbor, MI, USA.ORCID http://orcid.org/0000-0002-7902-7681
George LoewensteinDepartment of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.ORCID http://orcid.org/0000-0003-2790-0474
Jens LudwigHarris School of Public Policy, University of Chicago, Chicago, IL, USA.
Barbara MellersDepartment of Marketing, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Sendhil MullainathanDepartment of Behavioral Science, Booth School of Business, University of Chicago, Chicago, IL, USA.
Silvia SaccardoDepartment of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.
Jann SpiessDepartment of Operations, Information & Technology, Stanford Graduate School of Business, Stanford, CA, USA.
Gaurav SuriDepartment of Psychology, San Francisco State University, San Francisco, CA, USA.
Joachim H TalloenDepartment of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.
Jamie TaxerDepartment of Psychology, Stanford University, Stanford, CA, USA.
Yaacov TropeDepartment of Psychology, New York University, New York, NY, USA.
Lyle UngarDepartment of Computer and Information Sciences, University of Pennsylvania, Philadelphia, PA, USA.
Kevin G VolppDepartment of Medical Ethics and Health Policy, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Ashley WhillansDepartment of Negotiation, Organizations & Markets, Harvard Business School, Harvard University, Boston, MA, USA.
Jonathan ZinmanDepartment of Economics, Dartmouth College, Hanover, NH, USA.
Angela L DuckworthDepartment of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA. aduckworth@characterlab.org.ORCID http://orcid.org/0000-0002-2644-3729

Funding

The Penn Roybal Center on Behavioral Economics and Health: Solving for Scale and Impact with Design Thinking, Digital Platforms, and Dynamic AdaptationP30AG034546 · NIA · UNIVERSITY OF PENNSYLVANIA · PI Alison Meredith Buttenheim · 2009 to 2026
$10.6M
Pilot CoreP30AG034532 · NIA · NATIONAL BUREAU OF ECONOMIC RESEARCH · PI JOSEPH J DOYLE · 2009 to 2026
$10.2M
NIA NIH HHS P30 AG034532NIA NIH HHS P30 AG034546NIH HHS 5P30 AG034532
6 · The paper itself

Abstract

Policy-makers are increasingly turning to behavioural science for insights about how to improve citizens' decisions and outcomes

Indexed as

Research DesignAdultBehavioral SciencesClinical Trials as TopicExerciseFemaleHealth PromotionHumansMaleMotivationRegression AnalysisRewardTime FactorsUnited StatesUniversities

Identifiers

PMID34880497
PMCPMC8822539

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.