Evidence map›Paper›PMID 29106284›Full record

ArticleJournal of abnormal psychology2017

Further evidence that psychopathology networks have limited replicability and utility: Response to Borsboom et al. (2017) and Steinley et al. (2017).

Miriam K Forbes, Aidan G C Wright, Kristian E Markon, Robert F Krueger

Abstract readComment
In one paragraph

Article in Journal of abnormal psychology, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 32 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
32citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

32 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Networks of guilt, shame, pride, and disordered eating in youths show stability over time.Journal of research on adolescence : the official journal of the Society for Research on Adolescence · 2025
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Generalized network psychometrics of eating-disorder psychopathology.The International journal of eating disorders · 2022
    Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Review
  19. Article
  20. The network approach to psychopathology: promise versus reality.World psychiatry : official journal of the World Psychiatric Association (WPA) · 2019
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Miriam K ForbesDepartment of Psychiatry, University of Minnesota.
Aidan G C WrightDepartment of Psychology, University of Pittsburgh.
Kristian E MarkonDepartment of Psychological and Brain Sciences, University of Iowa.
Robert F KruegerDepartment of Psychology, University of Minnesota.

Funding

U19 MIDlife in the United States-Diversity Supplement-WellsU19AG051426 · NIA · UNIVERSITY OF WISCONSIN-MADISON · PI CAROL D. RYFF · 2016 to 2026
$74.8M
The impact of adverse interpersonal experiences (AIE) on mild cognitive impairment (MCI) and risk for Alzheimer's disease and related dementias (ADRD) in ethnically diverse twinsR01AG053217 · NIA · UNIVERSITY OF MINNESOTA · PI Robert F Krueger, Glenn I Roisman · 2016 to 2026
$9.1M
Comorbidity: Substance Use Disorders and Other Psychiatric ConditionsT32DA037183 · NIDA · UNIVERSITY OF MINNESOTA · PI Anna Zilverstand · 2014 to 2026
$3.2M
NIA NIH HHS R01 AG053217NIA NIH HHS U19 AG051426NIDA NIH HHS T32 DA037183NIH HHSNIMH NIH HHS L30 MH101760Templeton Foundation
6 · The paper itself

Abstract

In our target article, we tested the replicability of 4 popular psychopathology network estimation methods that aim to reveal causal relationships among symptoms of mental illness. We started with the focal data set from the 2 foundational psychopathology network papers (i.e., the National Comorbidity Survey-Replication) and identified the National Survey of Mental Health and Wellbeing as a close methodological match for comparison. We compared the psychopathology networks estimated in each data set-as well as in 10 sets of random split-halves within each data set-with the goal of quantifying the replicability of the network parameters as they are interpreted in the extant psychopathology network literature. We concluded that current psychopathology network methods have limited replicability both within and between samples and thus have limited utility. Here we respond to the 2 commentaries on our target article, concluding that the findings of Steinley, Hoffman, Brusco, and Sher (2017)-along with other recent developments in the literature-provide further conclusive evidence that psychopathology networks have poor replicability and utility. (PsycINFO Database Record

Indexed as

Mental DisordersPsychopathologyComorbidityHumans

Identifiers

PMID29106284
PMCPMC5687847

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.