ArticleBehavior research methods2023
A tutorial on Bayesian single-test reliability analysis with JASP.
Article in Behavior research methods, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
14 citing papers in PubMed.
- Layer-specific changes in sensory cortex across the lifespan in mice and humans.Nature neuroscience · 2025Article
- TOPSE for babies in Norwegian: examining the reliability of a tool to measure parenting self-efficacy.Primary health care research & development · 2025Article
- The Dark and Light Sides of Empathy: The Clinical Relevance of the Assessment of Cognitive and Affective Empathy Across Negative and Positive Emotions.European journal of investigation in health, psychology and education · 2025Article
- Reliability representativeness: How well does coefficient alpha summarize reliability across the score distribution?Behavior research methods · 2025Article
- Acute Effects of Unplanned and Planned Hop-Landing Training on Neurocognitive Function and Knee Biomechanics.Orthopaedic journal of sports medicine · 2025Article
- Psychometric validation of the WHO-5 and WHO-4 well-being index scales for assessing psychological well-being and detecting depression in Japanese school-aged children: a community-based study.Frontiers in public health · 2025Article
- The differential outcomes procedure for improving the recognition of dynamic facial expressions of emotion in people with autism spectrum disorders and first-degree relatives.Psychological research · 2024Article
- The Impact of Measurement Model Misspecification on Coefficient Omega Estimates of Composite Reliability.Educational and psychological measurement · 2024Article
- Assessing a measure for Quality of Life in patients with severe Alopecia Areata: a multicentric Italian study.Frontiers in public health · 2024Observational
- Brazilian Scale for Evaluation of Mental Health Care Needs: Additional Evidence.Revista de saude publica · 2024Article
- Confirmatory validation of a brief patient-reported outcome measure assessing psychological distress in caregivers of malignant mesothelioma patients: the Mesothelioma Psychological Distress Tool-Caregivers.Frontiers in psychology · 2024Article
- Family Vulnerability Scale: validity evidence in primary health care.Revista de saude publica · 2024Article
- Raven's Standard Progressive Matrices for Adolescents: A Case for a Shortened Version.Journal of Intelligence · 2023Article
- Five-Factor Model and DSM-5 Alternative Model of Personality Disorder Profile Construction: Associations with Cognitive Ability and Clinical Symptoms.Journal of Intelligence · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
The current practice of reliability analysis is both uniform and troublesome: most reports consider only Cronbach's α, and almost all reports focus exclusively on a point estimate, disregarding the impact of sampling error. In an attempt to improve the status quo we have implemented Bayesian estimation routines for five popular single-test reliability coefficients in the open-source statistical software program JASP. Using JASP, researchers can easily obtain Bayesian credible intervals to indicate a range of plausible values and thereby quantify the precision of the point estimate. In addition, researchers may use the posterior distribution of the reliability coefficients to address practically relevant questions such as "What is the probability that the reliability of my test is larger than a threshold value of .80?". In this tutorial article, we outline how to conduct a Bayesian reliability analysis in JASP and correctly interpret the results. By making available a computationally complex procedure in an easy-to-use software package, we hope to motivate researchers to include uncertainty estimates whenever reporting the results of a single-test reliability analysis.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.