Evidence map›Paper›PMID 32483374›Full record

ArticleNature2020

Variability in the analysis of a single neuroimaging dataset by many teams.

Rotem Botvinik-Nezer, Felix Holzmeister, Colin F Camerer, Anna Dreber, Juergen Huber, Magnus Johannesson, Michael Kirchler, Roni Iwanir, Jeanette A Mumford, R Alison Adcock and 187 more

Abstract read
In one paragraph

Article in Nature, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 516 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
516citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

516 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Trial
  9. Trial
  10. Article
  11. Review
  12. Article
  13. Review
  14. Article
  15. Critical-Network Lesion-Symptom Mapping.Human brain mapping · 2026
    Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article

456 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

197 authors.

Rotem Botvinik-NezerSagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel.ORCID http://orcid.org/0000-0003-2669-1877
Felix HolzmeisterDepartment of Banking and Finance, University of Innsbruck, Innsbruck, Austria.ORCID http://orcid.org/0000-0001-9606-0427
Colin F CamererHSS and CNS, California Institute of Technology, Pasadena, CA, USA.ORCID http://orcid.org/0000-0003-4049-1871
Anna DreberDepartment of Economics, Stockholm School of Economics, Stockholm, Sweden.ORCID http://orcid.org/0000-0003-3989-9941
Juergen HuberDepartment of Banking and Finance, University of Innsbruck, Innsbruck, Austria.
Magnus JohannessonDepartment of Economics, Stockholm School of Economics, Stockholm, Sweden.ORCID http://orcid.org/0000-0001-8759-6393
Michael KirchlerDepartment of Banking and Finance, University of Innsbruck, Innsbruck, Austria.ORCID http://orcid.org/0000-0002-5416-2545
Roni IwanirSagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel.
Jeanette A MumfordCenter for Healthy Minds, University of Wisconsin-Madison, Madison, WI, USA.
R Alison AdcockCenter for Cognitive Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0002-7859-5484
Paolo AvesaniNeuroinformatics Laboratory, Fondazione Bruno Kessler, Trento, Italy.ORCID http://orcid.org/0000-0001-8943-8911
Blazej M BaczkowskiDepartment of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.ORCID http://orcid.org/0000-0001-9827-797X
Aahana BajracharyaDepartment of Otolaryngology, Washington University in St. Louis, St. Louis, MO, USA.ORCID http://orcid.org/0000-0002-7361-6020
Leah BakstDepartment of Psychological and Brain Sciences, Boston University, Boston, MA, USA.ORCID http://orcid.org/0000-0003-2741-5532
Sheryl BallDepartment of Economics, Virginia Tech, Blacksburg, VA, USA.
Marco BarilariCrossmodal Perception and Plasticity Laboratory, Institutes for Research in Psychology (IPSY) and Neurosciences (IoNS), UCLouvain, Louvain-la-Neuve, Belgium.ORCID http://orcid.org/0000-0002-3313-3120
Nadège BaultSchool of Psychology, University of Plymouth, Plymouth, UK.ORCID http://orcid.org/0000-0001-8244-6062
Derek BeatonRotman Research Institute, Baycrest Health Sciences Centre, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0001-6118-4366
Julia BeitnerDepartment of Psychology, University of Amsterdam, Amsterdam, The Netherlands.ORCID http://orcid.org/0000-0002-2539-7011
Roland G BenoitMax Planck Research Group: Adaptive Memory, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.ORCID http://orcid.org/0000-0002-7127-4899
Ruud M W J BerkersMax Planck Research Group: Adaptive Memory, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.ORCID http://orcid.org/0000-0002-0347-2375
Jamil P BhanjiDepartment of Psychology, Rutgers University-Newark, Newark, NJ, USA.ORCID http://orcid.org/0000-0003-3451-8732
Bharat B BiswalDepartment of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, USA.
Sebastian Bobadilla-SuarezDepartment of Experimental Psychology, University College London, London, UK.ORCID http://orcid.org/0000-0002-5951-0772
Tiago BortoliniD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.ORCID http://orcid.org/0000-0003-2097-5537
Katherine L BottenhornDepartment of Psychology, Florida International University, Miami, FL, USA.ORCID http://orcid.org/0000-0002-7796-8795
Alexander BowringOxford Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, Nuffield Department of Population Health, University of Oxford, Oxford, UK.ORCID http://orcid.org/0000-0002-5553-7249
Senne BraemDepartment of Experimental Psychology, Ghent University, Ghent, Belgium.
Hayley R BrooksDepartment of Psychology, University of Denver, Denver, CO, USA.ORCID http://orcid.org/0000-0001-5371-2624
Emily G BrudnerDepartment of Psychology, Rutgers University-Newark, Newark, NJ, USA.ORCID http://orcid.org/0000-0002-9981-3807
Cristian B CalderonDepartment of Experimental Psychology, Ghent University, Ghent, Belgium.
Julia A CamilleriInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.
Jaime J CastrellonCenter for Cognitive Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0001-5834-7101
Luca CecchettiMoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy.ORCID http://orcid.org/0000-0001-5184-6477
Edna C CieslikInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.ORCID http://orcid.org/0000-0001-5491-5837
Zachary J ColeDepartment of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA.ORCID http://orcid.org/0000-0002-0692-5739
Olivier CollignonCenter for Mind/Brain Sciences - CIMeC, University of Trento, Rovereto, Italy.ORCID http://orcid.org/0000-0003-1882-3550
Robert W CoxNational Institute of Mental Health (NIMH), National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0002-0031-1568
William A CunninghamDepartment of Psychology, University of Toronto, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0002-7063-5859
Stefan CzoschkeInstitute of Medical Psychology, Goethe University, Frankfurt am Main, Germany.ORCID http://orcid.org/0000-0001-7863-8272
Kamalaker DadiInria, CEA, Université Paris-Saclay, Palaiseau, France.
Charles P DavisDepartment of Psychological Sciences, University of Connecticut, Storrs, CT, USA.ORCID http://orcid.org/0000-0002-7293-2769
Alberto De LucaPROVIDI Lab, Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands.ORCID http://orcid.org/0000-0002-2553-7299
Mauricio R DelgadoDepartment of Psychology, Rutgers University-Newark, Newark, NJ, USA.
Lysia DemetriouSection of Endocrinology and Investigative Medicine, Faculty of Medicine, Imperial College London, London, UK.ORCID http://orcid.org/0000-0001-5249-0900
Jeffrey B DennisonDepartment of Psychology, Temple University, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0003-0557-3548
Xin DiDepartment of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, USA.ORCID http://orcid.org/0000-0002-2422-9016
Erin W DickieKrembil Centre for Neuroinformatics, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0003-3028-9864
Ekaterina DobryakovaCenter for Traumatic Brain Injury Research, Kessler Foundation, East Hanover, NJ, USA.ORCID http://orcid.org/0000-0002-6005-2115
Claire L DonnatDepartment of Statistics, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0001-7079-8060
Juergen DukartInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.ORCID http://orcid.org/0000-0003-0492-5644
Niall W DuncanGraduate Institute of Mind, Brain and Consciousness, Taipei Medical University, Taipei, Taiwan.ORCID http://orcid.org/0000-0002-3225-9119
Joke DurnezDepartment of Psychology and Stanford Center for Reproducible Neuroscience, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0001-9030-2202
Amr EedInstituto de Neurociencias, CSIC-UMH, Alicante, Spain.ORCID http://orcid.org/0000-0002-9370-4917
Simon B EickhoffInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.
Andrew ErhartDepartment of Psychology, University of Denver, Denver, CO, USA.ORCID http://orcid.org/0000-0001-5195-0880
Laura FontanesiFaculty of Psychology, University of Basel, Basel, Switzerland.ORCID http://orcid.org/0000-0001-5067-9451
G Matthew FrickeComputer Science Department, University of New Mexico, Albuquerque, NM, USA.ORCID http://orcid.org/0000-0002-4466-8649
Shiguang FuSchool of Management, Zhejiang University of Technology, Hangzhou, China.ORCID http://orcid.org/0000-0002-1313-0176
Adriana GalvánDepartment of Psychology, University of California Los Angeles, Los Angeles, CA, USA.
Remi GauCrossmodal Perception and Plasticity Laboratory, Institutes for Research in Psychology (IPSY) and Neurosciences (IoNS), UCLouvain, Louvain-la-Neuve, Belgium.ORCID http://orcid.org/0000-0002-1535-9767
Sarah GenonInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.ORCID http://orcid.org/0000-0002-7087-7882
Tristan GlatardDepartment of Computer Science and Software Engineering, Concordia University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0003-2620-5883
Enrico GlereanDepartment of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland.ORCID http://orcid.org/0000-0003-0624-675X
Jelle J GoemanDepartment of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands.ORCID http://orcid.org/0000-0003-4283-0259
Sergej A E GolowinGraduate Institute of Mind, Brain and Consciousness, Taipei Medical University, Taipei, Taiwan.
Carlos González-GarcíaDepartment of Experimental Psychology, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0001-6627-5777
Krzysztof J GorgolewskiDepartment of Psychology, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0003-3321-7583
Cheryl L GradyRotman Research Institute, Baycrest Health Sciences Centre, Toronto, Ontario, Canada.
Mikella A GreenCenter for Cognitive Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0002-8896-8520
João F Guassi MoreiraDepartment of Psychology, University of California Los Angeles, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0001-8312-4487
Olivia GuestDepartment of Experimental Psychology, University College London, London, UK.ORCID http://orcid.org/0000-0002-1891-0972
Shabnam HakimiCenter for Cognitive Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0003-4122-6041
J Paul HamiltonCenter for Social and Affective Neuroscience, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden.ORCID http://orcid.org/0000-0001-7982-4659
Roeland HancockBrain Imaging Research Center, University of Connecticut, Storrs, CT, USA.ORCID http://orcid.org/0000-0001-8932-6872
Giacomo HandjarasMoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy.ORCID http://orcid.org/0000-0001-5677-8434
Bronson B HarryThe MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, New South Wales, Australia.ORCID http://orcid.org/0000-0003-0389-0945
Colin HawcoCampbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Ontario, Canada.
Peer HerholzMcConnell Brain Imaging Centre, The Neuro (Montreal Neurological Institute-Hospital), Faculty of Medicine, McGill University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0002-9840-6257
Gabrielle HermanCampbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0003-4695-5251
Stephan HeunisDepartment of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands.ORCID http://orcid.org/0000-0003-3503-9872
Felix HoffstaedterInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.
Jeremy HogeveenDepartment of Psychology, University of New Mexico, Albuquerque, NM, USA.ORCID http://orcid.org/0000-0001-9612-2085
Susan HolmesDepartment of Statistics, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0002-2208-8168
Chuan-Peng HuLeibniz-Institut für Resilienzforschung (LIR), Mainz, Germany.ORCID http://orcid.org/0000-0002-7503-5131
Scott A HuettelDepartment of Psychology and Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0002-5092-4936
Matthew E HughesSchool of Health Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia.ORCID http://orcid.org/0000-0001-5057-5556
Vittorio IacovellaCenter for Mind/Brain Sciences - CIMeC, University of Trento, Rovereto, Italy.ORCID http://orcid.org/0000-0002-0853-1573
Alexandru D IordanDepartment of Psychology, University of Michigan, Ann Arbor, MI, USA.ORCID http://orcid.org/0000-0002-1391-785X
Peder M IsagerDepartment of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology, Eindhoven, The Netherlands.ORCID http://orcid.org/0000-0002-6922-3590
Ayse I IsikDepartment of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.ORCID http://orcid.org/0000-0002-1652-9297
Andrew JahnfMRI Laboratory, University of Michigan, Ann Arbor, MI, USA.ORCID http://orcid.org/0000-0001-5286-049X
Matthew R JohnsonDepartment of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA.ORCID http://orcid.org/0000-0003-3953-8898
Tom JohnstoneSchool of Health Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia.ORCID http://orcid.org/0000-0001-8635-8158
Michael J E JosephCampbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0002-0068-230X
Anthony C JulianoCenter for Neuropsychology and Neuroscience Research, Kessler Foundation, East Hanover, NJ, USA.ORCID http://orcid.org/0000-0001-7433-6891
Joseph W KableDepartment of Psychology, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0001-6495-9040
Michalis KassinopoulosGraduate Program in Biological and Biomedical Engineering, McGill University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0003-4312-4401
Cemal KobaMoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy.ORCID http://orcid.org/0000-0001-7097-1441
Xiang-Zhen KongLanguage and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.ORCID http://orcid.org/0000-0002-0805-1350
Timothy R KoscikDepartment of Psychiatry, University of Iowa Carver College of Medicine, Iowa City, IA, USA.ORCID http://orcid.org/0000-0002-2551-8127
Nuri Erkut KucukboyaciCenter for Traumatic Brain Injury Research, Kessler Foundation, East Hanover, NJ, USA.ORCID http://orcid.org/0000-0002-7613-641X
Brice A KuhlDepartment of Psychology, University of Oregon, Eugene, OR, USA.ORCID http://orcid.org/0000-0001-5229-5400
Sebastian KupekFaculty of Economics and Statistics, University of Innsbruck, Innsbruck, Austria.
Angela R LairdDepartment of Physics, Florida International University, Miami, Florida, USA.ORCID http://orcid.org/0000-0003-3379-8744
Claus LammDepartment of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria.ORCID http://orcid.org/0000-0002-5422-0653
Robert LangnerInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.ORCID http://orcid.org/0000-0002-3237-001X
Nina LauharatanahirunUS CCDC Army Research Laboratory, Human Research and Engineering Directorate, Aberdeen Proving Ground, MD, USA.
Hongmi LeeDepartment of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA.ORCID http://orcid.org/0000-0001-8023-0727
Sangil LeeDepartment of Psychology, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0002-4443-9926
Alexander LeemansPROVIDI Lab, Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands.ORCID http://orcid.org/0000-0002-9306-6126
Andrea LeoMoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy.ORCID http://orcid.org/0000-0002-1948-6608
Elise LesageDepartment of Experimental Psychology, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0002-5517-6965
Flora LiFralin Biomedical Research Institute, Roanoke, VA, USA.ORCID http://orcid.org/0000-0002-9367-2257
Monica Y C LiDepartment of Psychological Sciences, University of Connecticut, Storrs, CT, USA.ORCID http://orcid.org/0000-0003-1775-4434
Phui Cheng LimDepartment of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA.ORCID http://orcid.org/0000-0002-5709-8956
Evan N LintzDepartment of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA.ORCID http://orcid.org/0000-0003-4077-7749
Schuyler W LiphardtBiology Department, University of New Mexico, Albuquerque, NM, USA.ORCID http://orcid.org/0000-0001-8370-8722
Annabel B Losecaat VermeerDepartment of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria.ORCID http://orcid.org/0000-0001-5631-0233
Bradley C LoveDepartment of Experimental Psychology, University College London, London, UK.ORCID http://orcid.org/0000-0002-7883-7076
Michael L MackDepartment of Psychology, University of Toronto, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0001-5155-7413
Norberto MalpicaLaboratorio de Análisis de Imagen Médica y Biometría (LAIMBIO), Universidad Rey Juan Carlos, Madrid, Spain.ORCID http://orcid.org/0000-0003-4618-7459
Theo MarinsD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.ORCID http://orcid.org/0000-0002-5017-707X
Camille MaumetInria, Univ Rennes, CNRS, Inserm, IRISA UMR 6074, Empenn ERL U 1228, Rennes, France.ORCID http://orcid.org/0000-0002-6290-553X
Kelsey McDonaldDepartment of Psychology and Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0002-7484-5300
Joseph T McGuireDepartment of Psychological and Brain Sciences, Boston University, Boston, MA, USA.ORCID http://orcid.org/0000-0001-6259-0809
Helena MeleroLaboratorio de Análisis de Imagen Médica y Biometría (LAIMBIO), Universidad Rey Juan Carlos, Madrid, Spain.ORCID http://orcid.org/0000-0002-5373-6711
Adriana S Méndez LealDepartment of Psychology, University of California Los Angeles, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0002-0147-9450
Benjamin MeyerLeibniz-Institut für Resilienzforschung (LIR), Mainz, Germany.
Kristin N MeyerDepartment of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.ORCID http://orcid.org/0000-0003-0190-7678
Glad MihaiMax Planck Research Group: Neural Mechanisms of Human Communication, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.ORCID http://orcid.org/0000-0001-5715-6442
Georgios D MitsisDepartment of Bioengineering, McGill University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0001-9975-5128
Jorge MollD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.
Dylan M NielsonData Science and Sharing Team, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0003-4613-6643
Gustav NilsonneDepartment of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden.ORCID http://orcid.org/0000-0001-5273-0150
Michael P NotterThe Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology, University Hospital Center and University of Lausanne, Lausanne, Switzerland.ORCID http://orcid.org/0000-0002-5866-047X
Emanuele OlivettiNeuroinformatics Laboratory, Fondazione Bruno Kessler, Trento, Italy.ORCID http://orcid.org/0000-0001-7653-1519
Adrian I OnicasMoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy.ORCID http://orcid.org/0000-0002-5953-8548
Paolo PapaleMoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy.ORCID http://orcid.org/0000-0002-6249-841X
Kaustubh R PatilInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.ORCID http://orcid.org/0000-0002-0289-5480
Jonathan E PeelleDepartment of Otolaryngology, Washington University in St. Louis, St. Louis, MO, USA.ORCID http://orcid.org/0000-0001-9194-854X
Alexandre PérezMcConnell Brain Imaging Centre, The Neuro (Montreal Neurological Institute-Hospital), Faculty of Medicine, McGill University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0003-0556-0763
Doris PischeddaBernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany.ORCID http://orcid.org/0000-0003-4694-2493
Jean-Baptiste PolineMcConnell Brain Imaging Centre, The Neuro (Montreal Neurological Institute-Hospital), Faculty of Medicine, McGill University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0002-9794-749X
Yanina PrystaukaDepartment of Psychological Sciences, University of Connecticut, Storrs, CT, USA.ORCID http://orcid.org/0000-0001-8258-2339
Shruti RayDepartment of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, USA.ORCID http://orcid.org/0000-0002-1864-386X
Patricia A Reuter-LorenzDepartment of Psychology, University of Michigan, Ann Arbor, MI, USA.ORCID http://orcid.org/0000-0002-6977-3429
Richard C ReynoldsScientific and Statistical Computing Core, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0002-7267-5563
Emiliano RicciardiMoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy.ORCID http://orcid.org/0000-0002-7178-9534
Jenny R RieckRotman Research Institute, Baycrest Health Sciences Centre, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0002-3242-6407
Anais M Rodriguez-ThompsonDepartment of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.ORCID http://orcid.org/0000-0002-3926-8958
Anthony RomynDepartment of Psychology, University of Toronto, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0002-6333-7888
Taylor SaloDepartment of Psychology, Florida International University, Miami, FL, USA.ORCID http://orcid.org/0000-0001-9813-3167
Gregory R Samanez-LarkinCenter for Cognitive Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0001-7846-3804
Emilio Sanz-MoralesLaboratorio de Análisis de Imagen Médica y Biometría (LAIMBIO), Universidad Rey Juan Carlos, Madrid, Spain.ORCID http://orcid.org/0000-0001-8066-9940
Margaret L SchlichtingDepartment of Psychology, University of Toronto, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0002-5433-8870
Douglas H SchultzDepartment of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA.ORCID http://orcid.org/0000-0003-0809-9036
Qiang ShenSchool of Management, Zhejiang University of Technology, Hangzhou, China.ORCID http://orcid.org/0000-0003-1330-1315
Margaret A SheridanDepartment of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Jennifer A SilversDepartment of Psychology, University of California Los Angeles, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0002-6615-5473
Kenny SkagerlundDepartment of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden.ORCID http://orcid.org/0000-0003-1894-3595
Alec SmithDepartment of Economics, Virginia Tech, Blacksburg, VA, USA.ORCID http://orcid.org/0000-0002-1938-4660
David V SmithDepartment of Psychology, Temple University, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0001-5754-9633
Peter Sokol-HessnerDepartment of Psychology, University of Denver, Denver, CO, USA.ORCID http://orcid.org/0000-0003-0895-5576
Simon R SteinkampInstitute of Neuroscience and Medicine, Cognitive Neuroscience (INM-3), Research Centre Jülich, Jülich, Germany.ORCID http://orcid.org/0000-0002-6437-0700
Sarah M TashjianDepartment of Psychology, University of California Los Angeles, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0002-0946-6662
Bertrand ThirionInria, CEA, Université Paris-Saclay, Palaiseau, France.ORCID http://orcid.org/0000-0001-5018-7895
John N ThorpDepartment of Psychology, Columbia University, New York, NY, USA.ORCID http://orcid.org/0000-0002-9307-6690
Gustav TinghögDepartment of Management and Engineering, Linköping University, Linköping, Sweden.ORCID http://orcid.org/0000-0002-8159-1249
Loreen TisdallDepartment of Psychology, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0001-6303-6148
Steven H TompsonUS CCDC Army Research Laboratory, Human Research and Engineering Directorate, Aberdeen Proving Ground, MD, USA.ORCID http://orcid.org/0000-0002-6315-1485
Claudio Toro-SereyDepartment of Psychological and Brain Sciences, Boston University, Boston, MA, USA.ORCID http://orcid.org/0000-0002-5273-2276
Juan Jesus Torre TresolsInria, CEA, Université Paris-Saclay, Palaiseau, France.
Leonardo TozziDepartment of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA.ORCID http://orcid.org/0000-0002-9429-6476
Vuong TruongGraduate Institute of Mind, Brain and Consciousness, Taipei Medical University, Taipei, Taiwan.ORCID http://orcid.org/0000-0003-1412-498X
Luca TurellaCenter for Mind/Brain Sciences - CIMeC, University of Trento, Rovereto, Italy.ORCID http://orcid.org/0000-0003-1096-2150
Anna E van 't VeerMethodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, The Netherlands.ORCID http://orcid.org/0000-0002-2733-1841
Tom VergutsDepartment of Experimental Psychology, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0002-7783-4754
Jean M VettelUS Combat Capabilities Development Command Army Research Laboratory, Aberdeen, MD, USA.ORCID http://orcid.org/0000-0001-5336-2986
Sagana VijayarajahDepartment of Psychology, University of Toronto, Toronto, Ontario, Canada.
Khoi VoCenter for Cognitive Neuroscience, Duke University, Durham, NC, USA.ORCID http://orcid.org/0000-0002-6000-2628
Matthew B WallInvicro, London, UK.ORCID http://orcid.org/0000-0002-0493-6274
Wouter D WeedaMethodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, The Netherlands.ORCID http://orcid.org/0000-0001-8619-2645
Susanne WeisInstitute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.ORCID http://orcid.org/0000-0001-7726-6470
David J WhiteCentre for Human Psychopharmacology, Swinburne University, Hawthorn, Victoria, Australia.ORCID http://orcid.org/0000-0001-8694-1474
David WisniewskiDepartment of Experimental Psychology, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0003-4793-1171
Alba Xifra-PorxasGraduate Program in Biological and Biomedical Engineering, McGill University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0002-9023-2432
Emily A YearlingDepartment of Psychological Sciences, University of Connecticut, Storrs, CT, USA.
Sangsuk YoonDepartment of Management and Marketing, School of Business, University of Dayton, Dayton, OH, USA.ORCID http://orcid.org/0000-0002-3399-1096
Rui YuanDepartment of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA.ORCID http://orcid.org/0000-0003-4800-3895
Kenneth S L YuenLeibniz-Institut für Resilienzforschung (LIR), Mainz, Germany.ORCID http://orcid.org/0000-0002-9465-9070
Lei ZhangDepartment of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria.ORCID http://orcid.org/0000-0002-9586-595X
Xu ZhangBrain Imaging Research Center, University of Connecticut, Storrs, CT, USA.ORCID http://orcid.org/0000-0003-1988-7767
Joshua E ZoskyDepartment of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA.ORCID http://orcid.org/0000-0002-1962-3633
Thomas E NicholsOxford Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, Nuffield Department of Population Health, University of Oxford, Oxford, UK. thomas.nichols@bdi.ox.ac.uk.ORCID http://orcid.org/0000-0002-4516-5103
Russell A PoldrackDepartment of Psychology, Stanford University, Stanford, CA, USA. poldrack@stanford.edu.ORCID http://orcid.org/0000-0001-6755-0259
Tom SchonbergSagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel. schonberg@tauex.tau.ac.il.ORCID http://orcid.org/0000-0002-4485-816X

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
University of New Mexico (UNM) Center for Brain Recovery and RepairP20GM109089 · NIGMS · UNIVERSITY OF NEW MEXICO HEALTH SCIS CTR · PI SHUTTLEWORTH, CLAUDE W · 2015 to 2024
$22.7M
Resource DiscoveryP41EB019936 · NIBIB · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI David Nelson Kennedy · 2016 to 2026
$15.2M
OpenNeuro: An open archive for analysis and sharing of BRAIN Initiative dataR24MH117179 · NIMH · STANFORD UNIVERSITY · PI Russell A Poldrack · 2018 to 2026
$11.6M
Large-scale meta-analysis of functional MRI dataR01MH096906 · NIMH · UNIVERSITY OF TEXAS AT AUSTIN · PI Alejandro De La Vega · 2012 to 2026
$7.9M
Exposing the Deep Content of the Publication: Knowledge Extraction for Neuroimaging in Child PsychiatryR01MH083320 · NIMH · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI FRAZIER, JEAN A, KENNEDY, DAVID NELSON · 2009 to 2020
$6.3M
Neuroimaging meta-analytics for addiction: Nodes, networks,and new heuristicsR01DA041353 · NIDA · FLORIDA INTERNATIONAL UNIVERSITY · PI LAIRD, ANGELA R, SUTHERLAND, MATTHEW T · 2017 to 2019
$645k
NCATS NIH HHS UL1 TR001863NIBIB NIH HHS P41 EB019936NIDA NIH HHS R01 DA041353NIGMS NIH HHS P20 GM109089NIMH NIH HHS R01 MH083320NIMH NIH HHS R01 MH096906NIMH NIH HHS R24 MH117179Wellcome Trust 100309/Z/12/Z
6 · The paper itself

Abstract

Data analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses

Indexed as

Data AnalysisData ScienceDatasets as TopicFunctional NeuroimagingMagnetic Resonance ImagingResearch PersonnelBrainFemaleHumansLogistic ModelsMaleMeta-Analysis as TopicModels, NeurologicalReproducibility of ResultsSoftware

Identifiers

PMID32483374
PMCPMC7771346

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.