Evidence map›Paper›PMID 35129781›Full record

SynthesisPsychonomic bulletin & review2022

Across-subject correlation between confidence and accuracy: A meta-analysis of the Confidence Database.

Sunny Jin, Paul Verhaeghen, Dobromir Rahnev

Abstract readMeta-Analysis
In one paragraph

Synthesis in Psychonomic bulletin & review, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Confidence in naturalistic decision making.Neuroscience of consciousness · 2026
    Article
  5. Article
  6. Neural Oscillation as a Selective Modulatory Mechanism on Decision Confidence, Speed, and Accuracy.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
  7. Article
  8. Article
  9. Challenging the Bayesian confidence hypothesis in perceptual decision-making.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Sunny JinSchool of Psychology, Georgia Institute of Technology, 654 Cherry Str. NW, Atlanta, GA, 30332, USA.
Paul VerhaeghenSchool of Psychology, Georgia Institute of Technology, 654 Cherry Str. NW, Atlanta, GA, 30332, USA.
Dobromir RahnevSchool of Psychology, Georgia Institute of Technology, 654 Cherry Str. NW, Atlanta, GA, 30332, USA. rahnev@psych.gatech.edu.

Funding

Uncovering the Architecture of MetacognitionR01MH119189 · NIMH · GEORGIA INSTITUTE OF TECHNOLOGY · PI RAHNEV, DOBROMIR · 2020 to 2024
$1.5M
NIMH NIH HHS R01 MH119189
6 · The paper itself

Abstract

If one friend confidently tells us to buy Product A while another friend thinks that Product B is better but is not confident, we may go with the advice of our confident friend. Should we? The relationship between people's confidence and accuracy has been of great interest in many fields, especially in high-stakes situations like eyewitness testimony. However, there is still little consensus about how much we should trust someone's overall confidence level. Here, we examine the across-subject relationship between average accuracy and average confidence in 213 unique datasets from the Confidence Database. This approach allows us to empirically address this issue with unprecedented statistical power and check for the presence of various moderators. We find an across-subject correlation between average accuracy and average confidence of R = .22. Importantly, this relationship is much stronger for memory than for perception tasks ("domain effect"), as well as for confidence scales with fewer points ("granularity effect"). These results show that we should take one's confidence seriously (and perhaps buy Product A) and suggest several factors that moderate the relative consistency of how people make confidence judgments.

Indexed as

JudgmentMetacognitionData CollectionFriendsHumansTrustBiascalibrationConfidenceMemoryMetacognitionPerceptual decision making

Identifiers

PMID35129781
PMCPMC10777204

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.