Evidence map›Paper›PMID 32901345›Full record

ArticleBehavior research methods2021

ADOpy: a python package for adaptive design optimization.

Jaeyeong Yang, Mark A Pitt, Woo-Young Ahn, Jay I Myung

Open access · bronzeAbstract read
In one paragraph

Article in Behavior research methods, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
2.6field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 22 citations in OpenAlex.

  1. Rapid and reliable computational markers of decision-making for predicting daily smoking behavior and smoking cessation treatment outcomes.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2026
    Article
  2. Article
  3. Review
  4. Rumination Derails Reinforcement Learning with Possible Implications for Ineffective Behavior.Clinical psychological science : a journal of the Association for Psychological Science · 2022
    Article
  5. Adaptive Design Optimization for a Mnemonic Similarity Task.Journal of mathematical psychology · 2022
    Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 2 countries.

Jaeyeong YangDepartment of Psychology, Seoul National University, Seoul, Korea.
Mark A PittDepartment of Psychology, Ohio State University, Columbus, OH, USA.
Woo-Young AhnDepartment of Psychology, Seoul National University, Seoul, Korea. wahn55@snu.ac.kr.
Jay I MyungDepartment of Psychology, Ohio State University, Columbus, OH, USA. myung.1@osu.edu.
Seoul National University · KRThe Ohio State University · US

Funding

Adaptive Experimental Methods for Evaluating Computational Models of CognitionR01MH093838 · NIMH · OHIO STATE UNIVERSITY · PI PITT, MARK A · 2011 to 2015
$1.6M
NIMH NIH HHS R01 MH093838
6 · The paper itself

Abstract

Experimental design is fundamental to research, but formal methods to identify good designs are lacking. Advances in Bayesian statistics and machine learning offer algorithm-based ways to identify good experimental designs. Adaptive design optimization (ADO; Cavagnaro, Myung, Pitt, & Kujala, 2010; Myung, Cavagnaro, & Pitt, 2013) is one such method. It works by maximizing the informativeness and efficiency of data collection, thereby improving inference. ADO is a general-purpose method for conducting adaptive experiments on the fly and can lead to rapid accumulation of information about the phenomenon of interest with the fewest number of trials. The nontrivial technical skills required to use ADO have been a barrier to its wider adoption. To increase its accessibility to experimentalists at large, we introduce an open-source Python package, ADOpy, that implements ADO for optimizing experimental design. The package, available on GitHub, is written using high-level modular-based commands such that users do not have to understand the computational details of the ADO algorithm. In this paper, we first provide a tutorial introduction to ADOpy and ADO itself, and then illustrate its use in three walk-through examples: psychometric function estimation, delay discounting, and risky choice. Simulation data are also provided to demonstrate how ADO designs compare with other designs (random, staircase).

Indexed as

AlgorithmsResearch DesignBayes TheoremComputer SimulationMachine LearningBayesian adaptive experimentationCognitive modelingDelay discountingOptimal experimental designPsychometric function estimationRisky choice

Identifiers

PMID32901345
PMCPMC9335234
OpenAlexW3084498641

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.