Evidence map›Paper›PMID 32249207›Full record

ArticleBiological psychiatry. Cognitive neuroscience and neuroimaging2020

Improving the Reliability of Computational Analyses: Model-Based Planning and Its Relationship With Compulsivity.

Vanessa M Brown, Jiazhou Chen, Claire M Gillan, Rebecca B Price

Open access · greenAbstract read
In one paragraph

Article in Biological psychiatry. Cognitive neuroscience and neuroimaging, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 56 papers.

0numbers the graph read from it
0cells of the map it votes in
56citing papers in PubMed
10.2field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

56 citing papers in PubMed, 103 citations in OpenAlex.

  1. Trial
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Associations Between Steep Delay Discounting and Punishment Learning.Computational psychiatry (Cambridge, Mass.) · 2026
    Article
  8. Neural Bases of Affect-Based Impulsivity: A Decision Neuroscience Account.Computational psychiatry (Cambridge, Mass.) · 2026
    Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Reinforcement-Learning-Informed Queries Guide Behavioral Change.Clinical psychological science : a journal of the Association for Psychological Science · 2024
    Article
  17. Revisiting the role of computational neuroimaging in the era of integrative neuroscience.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024
    Review
  18. Article
  19. Language sentiment predicts changes in depressive symptoms.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 2 countries.

Vanessa M BrownDepartment of Psychiatry, University of Pittsburgh, Pittsburgh, PA. Electronic address: brownvm2@upmc.edu.
Jiazhou ChenDepartment of Psychiatry, University of Pittsburgh, Pittsburgh, PA.
Claire M GillanDepartment of Psychology, Trinity College Dublin, Dublin, Ireland.
Rebecca B PriceDepartment of Psychiatry, University of Pittsburgh, Pittsburgh, PA. Electronic address: pricerb@upmc.edu.
University of Pittsburgh · USTrinity College Dublin · IE

Funding

CLINICAL RESEARCH TRAINING IN LATE-LIFE MOOD DISORDERST32MH019986 · NIMH · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI HOWARD J AIZENSTEIN, Carmen Andreescu · 1997 to 2026
$6.9M
Testing the causal role of orbitofrontal cortex in human compulsive behavior: a non-invasive brain stimulation studyR21MH112770 · NIMH · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI PRICE, REBECCA · 2017 to 2018
$402k
NIMH NIH HHS R21 MH112770NIMH NIH HHS T32 MH019986
6 · The paper itself

Abstract

backgroundComputational models show great promise in mapping latent decision-making processes onto dissociable neural substrates and clinical phenotypes. One prominent example in reinforcement learning is model-based planning, which specifically relates to transdiagnostic compulsivity. However, the reliability of computational model-derived measures such as model-based planning is unclear. Establishing reliability is necessary to ensure that such models measure stable, traitlike processes, as assumed in computational psychiatry. Although analysis approaches affect validity of reinforcement learning models and reliability of other task-based measures, their effect on reliability of reinforcement learning models of empirical data has not been systematically studied.

methodsWe first assessed within- and across-session reliability and effects of analysis approaches (model estimation, parameterization, and data cleaning) of measures of model-based planning in patients with compulsive disorders (n = 38). The analysis approaches affecting test-retest reliability were tested in 3 large generalization samples (healthy participants: n = 541 and 111; people with a range of compulsivity: n = 1413).

resultsAnalysis approaches greatly influenced reliability: reliability of model-based planning measures ranged from 0 (no concordance) to above 0.9 (acceptable for clinical applications). The largest influence on reliability was whether model-estimation approaches were robust and accounted for the hierarchical structure of estimated parameters. Improvements in reliability generalized to other datasets and greatly reduced the sample size needed to find a relationship between model-based planning and compulsivity in an independent dataset.

conclusionsThese results indicate that computational psychiatry measures such as model-based planning can reliably measure latent decision-making processes, but when doing so must assess the ability of methods to estimate complex models from limited data.

Indexed as

PsychiatryReinforcement, PsychologyHumansLearningReproducibility of ResultsCompulsivityComputational modelingComputational psychiatryPsychometricsReinforcement learningReliability

Identifiers

PMID32249207
PMCPMC7286766
OpenAlexW2999059028

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.