Evidence map›Paper›PMID 29595294›Full record

ArticlePsychological methods2018

Benchmark validation of statistical models: Application to mediation analysis of imagery and memory.

David P MacKinnon, Matthew J Valente, Ingrid C Wurpts

Abstract read
In one paragraph

Article in Psychological methods, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. A Unification of Mediator, Confounder, and Collider Effects.Prevention science : the official journal of the Society for Prevention Research · 2021
    Article
  4. Article
  5. Article
  6. A Tutorial in Bayesian Potential Outcomes Mediation Analysis.Structural equation modeling : a multidisciplinary journal · 2018
    Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

David P MacKinnonDepartment of Psychology, Arizona State University.
Matthew J ValenteDepartment of Psychology, Arizona State University.
Ingrid C WurptsDepartment of Psychology, Arizona State University.

Funding

STATISTICAL METHODS FOR MENTAL HEALTH PREVENTIVE TRIALSR01MH040859 · NIMH · UNIVERSITY OF SOUTH FLORIDA · PI BROWN, C. HENDRICKS · 1986 to 2014
$7.5M
Estimating Mediation Effects in Prevention StudiesR37DA009757 · NIDA · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI MACKINNON, DAVID P · 2015 to 2024
$3.5M
Modern Longitudinal Mediation Methods for Prevention StudiesF31DA043317 · NIDA · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI VALENTE, MATTHEW JOHN · 2017 to 2018
$65k
National Institute on Drug AbuseNational Institute on Mental HealthNIDA NIH HHS F31 DA043317NIDA NIH HHS R37 DA009757NIMH NIH HHS R01 MH040859
6 · The paper itself

Abstract

This article describes benchmark validation, an approach to validating a statistical model. According to benchmark validation, a valid model generates estimates and research conclusions consistent with a known substantive effect. Three types of benchmark validation-(a) benchmark value, (b) benchmark estimate, and (c) benchmark effect-are described and illustrated with examples. Benchmark validation methods are especially useful for statistical models with assumptions that are untestable or very difficult to test. Benchmark effect validation methods were applied to evaluate statistical mediation analysis in eight studies using the established effect that increasing mental imagery improves recall of words. Statistical mediation analysis led to conclusions about mediation that were consistent with established theory that increased imagery leads to increased word recall. Benchmark validation based on established substantive theory is discussed as a general way to investigate characteristics of statistical models and a complement to mathematical proof and statistical simulation. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Indexed as

BenchmarkingData Interpretation, StatisticalModels, PsychologicalModels, StatisticalHumansImaginationMemoryPsychology

Identifiers

PMID29595294
PMCPMC6163101

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.