ArticleNature human behaviour2020
The Confidence Database.
Abstract read
In one paragraph
Article in Nature human behaviour, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 68 papers, 1 of them a synthesis that pooled it.
0numbers the graph read from it
0cells of the map it votes in
68citing papers in PubMed, 1 pooled it
–field-weighted citation impact
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
68 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Across-subject correlation between confidence and accuracy: A meta-analysis of the Confidence Database.Psychonomic bulletin & review · 2022Pooled it
- Reliability of LLMs as medical assistants for the general public: a randomized preregistered study.Nature medicine · 2026Trial
- Metacognition and metacognitive monitoring in aging.Psychonomic bulletin & review · 2026Review
- Introducing openESM: A database of openly available experience sampling datasets.Behavior research methods · 2026Article
- Modeling the cognitive processes of accepting clinical decision support.Quarterly journal of experimental psychology (2006) · 2026Article
- dynConfiR: An R package for sequential sampling models of decision confidence.Behavior research methods · 2026Article
- Dopamine Dynamics in the Nucleus Accumbens Reflect Confidence in Detecting the Occurrence and Nonoccurrence of Visual Signals in Perceptual Decision-Making.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2026Article
- Article
- A large-scale dataset of choice and response-time data in intertemporal choice.Scientific data · 2026Article
- Psychophysical dissection of temporal error monitoring.Cognitive processing · 2026Article
- Metacognitive ability is associated with reduced emotion suppression.Scientific reports · 2026Article
- Response Time as a Proxy for Decision Confidence: Insights From Type-2 ROC Analysis.Open mind : discoveries in cognitive science · 2026Article
- Reappraising intuitions about consciousness.Frontiers in psychology · 2026Article
- Physicians' metacognition in medical decision-making.Neuroscience of consciousness · 2026Article
- Large-scale experimental investigation of the reliability of confidence measures.Communications psychology · 2025Article
- Individual differences do not mask effects of unconscious processing.Psychonomic bulletin & review · 2025Review
- The order of task decisions and confidence ratings has little effect on metacognition.Communications psychology · 2025Article
- A dream EEG and mentation database.Nature communications · 2025Article
- Neural mechanisms of resource allocation in working memory.Science advances · 2025Article
- Investigation of mitochondrial DNA methylation-related prognostic biomarkers in hepatocellular carcinoma using The Cancer Genome Atlas (TCGA) database.Translational cancer research · 2025Article
8 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
83 authors.
Dobromir RahnevSchool of Psychology, Georgia Institute of Technology, Atlanta, GA, USA. rahnev@psych.gatech.edu.ORCID http://orcid.org/0000-0002-5265-2559
Kobe DesenderDepartment of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Alan L F LeeDepartment of Applied Psychology and Wofoo Joseph Lee Consulting and Counselling Psychology Research Centre, Lingnan University, Tuen Mun, Hong Kong.ORCID http://orcid.org/0000-0001-6722-6889
William T AdlerCenter for Neural Science, New York University, New York, NY, USA.ORCID http://orcid.org/0000-0003-4720-7861
David Aguilar-LleydaCentre d'Économie de la Sorbonne, CNRS & Université Paris 1 Panthéon-Sorbonne, Paris, France.ORCID http://orcid.org/0000-0001-6963-4069
Başak AkdoğanDepartment of Psychology, Columbia University, New York, NY, USA.ORCID http://orcid.org/0000-0002-6115-9897
Polina ArbuzovaBernstein Center for Computational Neuroscience, Berlin, Germany.ORCID http://orcid.org/0000-0002-4917-9633
Lauren Y AtlasNational Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, MD, USA.
Fuat BalcıDepartment of Psychology, Koç University, Istanbul, Turkey.ORCID http://orcid.org/0000-0003-3390-9352
Ji Won BangDepartment of Ophthalmology, New York University (NYU) School of Medicine, NYU Langone Health, New York, NY, USA.
Indrit BègueDepartment of Psychiatry and Mental Health, University Hospitals of Geneva and University of Geneva, Geneva, Switzerland.ORCID http://orcid.org/0000-0001-5350-4454
Damian P BirneySchool of Psychology, University of Sydney, Sydney, New South Wales, Australia.ORCID http://orcid.org/0000-0001-6075-5040
Timothy F BradyDepartment of Psychology, University of California, San Diego, La Jolla, CA, USA.ORCID http://orcid.org/0000-0001-5924-5211
Joshua Calder-TravisDepartment of Experimental Psychology, University of Oxford, Oxford, UK.ORCID http://orcid.org/0000-0003-3764-2042
Andrey ChetverikovDonders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, the Netherlands.ORCID http://orcid.org/0000-0003-2767-6310
Torin K ClarkSmead Aerospace Engineering Sciences, University of Colorado, Boulder, CO, USA.ORCID http://orcid.org/0000-0002-9345-9712
Karen DavrancheAix Marseille University, CNRS, LPC, Marseille, France.
Rachel N DenisonDepartment of Psychology and Center for Neural Science, New York University, New York, NY, USA.ORCID http://orcid.org/0000-0002-6304-5236
Troy C DildineNational Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0002-0892-7527
Kit S DoubleDepartment of Education, University of Oxford, Oxford, UK.ORCID http://orcid.org/0000-0001-8120-1573
Yalçın A DuyanDepartment of Psychology, Koç University, Istanbul, Turkey.ORCID http://orcid.org/0000-0002-4527-0165
Nathan FaivreLaboratoire de Psychologie et Neurocognition, Université Grenoble Alpes, Grenoble, France.ORCID http://orcid.org/0000-0001-6011-4921
Kaitlyn FallowDepartment of Psychology, University of Victoria, Victoria, British Columbia, Canada.
Elisa FilevichBernstein Center for Computational Neuroscience, Berlin, Germany.
Thibault GajdosAix Marseille University, CNRS, LPC, Marseille, France.ORCID http://orcid.org/0000-0001-6906-4836
Regan M GallagherSchool of Psychology, University of Queensland, Brisbane, Queensland, Australia.ORCID http://orcid.org/0000-0003-2600-8273
Vincent de GardelleParis School of Economics and CNRS, Paris, France.ORCID http://orcid.org/0000-0001-5977-5597
Sabina GhermanInstitute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK.
Nadia HaddaraSchool of Psychology, Georgia Institute of Technology, Atlanta, GA, USA.ORCID http://orcid.org/0000-0002-7294-599X
Marine HainguerlotErasmus School of Economics, Erasmus University Rotterdam, Rotterdam, the Netherlands.
Tzu-Yu HsuGraduate Institute of Mind, Brain, and Consciousness, Taipei Medical University, Taipei, Taiwan.ORCID http://orcid.org/0000-0001-6157-9114
Xiao HuCollaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University, Beijing, China.ORCID http://orcid.org/0000-0002-8899-6273
Iñaki IturrateNational Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0001-7781-7826
Matt JaquieryDepartment of Experimental Psychology, University of Oxford, Oxford, UK.
Justin KantnerDepartment of Psycholgoy, California State University, Northridge, CA, USA.
Marcin KoculakConsciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland.ORCID http://orcid.org/0000-0002-8839-2365
Mahiko KonishiLaboratoire de Sciences Cognitives et de Psycholinguistique, Department d'Etudes Cognitives, ENS, PSL University, EHESS, CNRS, Paris, France.
Christina KoßBernstein Center for Computational Neuroscience, Berlin, Germany.ORCID http://orcid.org/0000-0002-1694-5653
Peter D KvamDepartment of Psychology, University of Florida, Gainesville, FL, USA.ORCID http://orcid.org/0000-0002-3195-8452
Sze Chai KwokShanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China.ORCID http://orcid.org/0000-0002-7439-1193
Maël LebretonSwiss Center for Affective Science and LaBNIC, Department of Basic Neuroscience, University of Geneva, Geneva, Switzerland.ORCID http://orcid.org/0000-0002-2071-4890
Karolina M LempertDepartment of Psychology, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0001-7308-5568
Chien Ming LoGraduate Institute of Mind, Brain, and Consciousness, Taipei Medical University, Taipei, Taiwan.ORCID http://orcid.org/0000-0002-8011-1813
Liang LuoCollaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University, Beijing, China.
Brian ManiscalcoDepartment of Bioengineering, University of California, Riverside, Riverside, CA, USA.
Antonio MartinGraduate Institute of Mind, Brain, and Consciousness, Taipei Medical University, Taipei, Taiwan.
Sébastien MassoniUniversité de Lorraine, Université de Strasbourg, CNRS, BETA, Nancy, France.ORCID http://orcid.org/0000-0001-6980-7505
Julian MatthewsSchool of Psychological Sciences, Monash University, Melbourne, Victoria, Australia.ORCID http://orcid.org/0000-0002-1895-3403
Audrey MazancieuxLaboratoire de Psychologie et Neurocognition, Université Grenoble Alpes, Grenoble, France.ORCID http://orcid.org/0000-0003-1764-3582
Daniel M MerfeldOtolaryngology-Head and Neck Surgery, The Ohio State University, Columbus, OH, USA.
Denis O'HoraSchool of Psychology, National University of Ireland Galway, Galway, Ireland.ORCID http://orcid.org/0000-0003-3776-6782
Eleanor R PalserDepartment of Neurology, University of California, San Francisco, San Francisco, CA, USA.ORCID http://orcid.org/0000-0002-2760-4184
Borysław PaulewiczSWPS University of Social Sciences and Humanities, Katowice Faculty of Psychology, Katowice, Poland.
Michael PereiraLaboratory of Cognitive Neuroscience, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.ORCID http://orcid.org/0000-0003-0778-674X
Caroline PetersBernstein Center for Computational Neuroscience, Berlin, Germany.
Marios G PhiliastidesInstitute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK.ORCID http://orcid.org/0000-0002-7683-3506
Gerit PfuhlDepartment of Psychology, UiT the Arctic University of Norway, Tromso, Norway.ORCID http://orcid.org/0000-0002-3271-6447
Fernanda PrietoFaculty of Psychology, Universidad del Desarrollo, Santiago, Chile.ORCID http://orcid.org/0000-0002-2273-9100
Manuel RauschCatholic University of Eichstätt-Ingolstadt, Eichstätt, Germany.ORCID http://orcid.org/0000-0002-5805-5544
Samuel RechtLaboratoire des Systèmes Perceptifs, Département d'Études Cognitives, École normale supérieure-PSL University, CNRS, Paris, France.ORCID http://orcid.org/0000-0003-0317-2994
Gabriel ReyesFaculty of Psychology, Universidad del Desarrollo, Santiago, Chile.ORCID http://orcid.org/0000-0002-3915-1119
Marion RouaultDépartement d'Études Cognitives, École Normale Supérieure-PSL University, CNRS, EHESS, INSERM, Paris, France.ORCID http://orcid.org/0000-0001-6586-3788
Jérôme SackurDépartement d'Études Cognitives, École Normale Supérieure-PSL University, CNRS, EHESS, INSERM, Paris, France.ORCID http://orcid.org/0000-0002-8674-0370
Saeedeh SadeghiDepartment of Human Development, Cornell University, Ithaca, NY, USA.ORCID http://orcid.org/0000-0002-0668-8147
Jason SamahaDepartment of Psychology, University of California, Santa Cruz, Santa Cruz, CA, USA.ORCID http://orcid.org/0000-0001-8010-5993
Tricia X F SeowSchool of Psychology, Trinity College Dublin, Dublin, Ireland.ORCID http://orcid.org/0000-0002-5930-8929
Medha ShekharSchool of Psychology, Georgia Institute of Technology, Atlanta, GA, USA.ORCID http://orcid.org/0000-0002-5205-7274
Maxine T ShermanSackler Centre for Consciousness Science, Brighton, UK.ORCID http://orcid.org/0000-0002-0954-7040
Marta SiedleckaConsciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland.ORCID http://orcid.org/0000-0002-0688-4500
Zuzanna SkóraConsciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland.
Chen SongCardiff University Brain Research Imaging Centre, School of Psychology, Cardiff University, Cardiff, UK.ORCID http://orcid.org/0000-0002-5418-5747
David SotoBasque Center on Cognition, Brain and Language, San Sebastian, Spain.ORCID http://orcid.org/0000-0003-0205-7513
Sai SunDivisions of Biology and Biological Engineering and Computation and Neural Systems, California Institute of Technology, Pasadena, CA, USA.
Jeroen J A van BoxtelSchool of Psychological Sciences, Monash University, Melbourne, Victoria, Australia.ORCID http://orcid.org/0000-0003-2643-0474
Shuo WangDepartment of Chemical and Biomedical Engineering and Rockefeller Neuroscience Institute, West Virginia University, Morgantown, WV, USA.ORCID http://orcid.org/0000-0003-2562-0225
Christoph T WeidemannDepartment of Psychology, Swansea University, Swansea, UK.ORCID http://orcid.org/0000-0002-4280-2744
Gabriel WeindelAix Marseille University, CNRS, LPC, Marseille, France.ORCID http://orcid.org/0000-0002-7592-1686
Michał WierzchońConsciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland.ORCID http://orcid.org/0000-0002-7347-2696
Xinming XuShanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China.
Qun YeShanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China.ORCID http://orcid.org/0000-0003-0589-5416
Jiwon YeonSchool of Psychology, Georgia Institute of Technology, Atlanta, GA, USA.ORCID http://orcid.org/0000-0003-2737-4830
Futing ZouShanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China.
Ariel ZylberbergDepartment of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA.ORCID http://orcid.org/0000-0002-2572-4748
Funding
Neural and psychological mechanisms of pain perception ZIAAT000030 · NCCIH · NATIONAL CENTER FOR COMPLEMENTARY & INTEGRATIVE HEALTH · PI ATLAS, LAUREN · 2015 to 2025
$3.8MUncovering the Architecture of MetacognitionR01MH119189 · NIMH · GEORGIA INSTITUTE OF TECHNOLOGY · PI RAHNEV, DOBROMIR · 2020 to 2024
$1.5MUncovering the Architecture of MetacognitionR56MH119189 · NIMH · GEORGIA INSTITUTE OF TECHNOLOGY · PI RAHNEV, DOBROMIR · 2019 to 2019
$334kNIMH NIH HHS R01 MH119189NIMH NIH HHS R56 MH119189Wellcome Trust 209192/Z/17/Z
Abstract
Understanding how people rate their confidence is critical for the characterization of a wide range of perceptual, memory, motor and cognitive processes. To enable the continued exploration of these processes, we created a large database of confidence studies spanning a broad set of paradigms, participant populations and fields of study. The data from each study are structured in a common, easy-to-use format that can be easily imported and analysed using multiple software packages. Each dataset is accompanied by an explanation regarding the nature of the collected data. At the time of publication, the Confidence Database (which is available at https://osf.io/s46pr/) contained 145 datasets with data from more than 8,700 participants and almost 4 million trials. The database will remain open for new submissions indefinitely and is expected to continue to grow. Here we show the usefulness of this large collection of datasets in four different analyses that provide precise estimations of several foundational confidence-related effects.
Indexed as
PsychometricsTask Performance and AnalysisAdultChoice BehaviorDatabases, FactualDatasets as TopicHumansMental ProcessesMetacognitionReaction Time
Identifiers
What OpenQuestion holds
Textmetadata
LicenceTDM
Read underepoch 390
Registered trials
None linked
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.