Evidence map›Paper›PMID 31647202›Full record

SynthesisBrain and behavior2019

Assessing the unwanted: A systematic review of instruments used to assess negative effects of psychotherapy.

Philipp Herzog, Sören Lauff, Winfried Rief, Eva-Lotta Brakemeier

Abstract readSystematic Review
In one paragraph

Synthesis in Brain and behavior, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Systematic review of the psychometric properties of quality-of-life outcome measures used with adult inpatient psychiatric populations.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Pooled it
  2. Prevention of depression in adults with long-term physical conditions.The Cochrane database of systematic reviews · 2021
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Review
  8. Article
  9. The Development and Acceptability of a Psychology-Based Intervention for Debilitating Symptom Complexes Attributed to Ticks.Health expectations : an international journal of public participation in health care and health policy · 2026
    Article
  10. Article
  11. Innovations to improve outcomes and uptake of psychotherapies for mental disorders: a state-of-the-art review.World psychiatry : official journal of the World Psychiatric Association (WPA) · 2026
    Article
  12. Article
  13. Article
  14. Understanding side effects of psychotherapies: implications for clinical practice and research trials.World psychiatry : official journal of the World Psychiatric Association (WPA) · 2025
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Philipp HerzogDepartment of Clinical Psychology and Psychotherapy, Philipps-Universität Marburg, Marburg, Germany.ORCID 0000-0002-8267-2083
Sören LauffDepartment of Clinical Psychology and Psychotherapy, Philipps-Universität Marburg, Marburg, Germany.
Winfried RiefDepartment of Clinical Psychology and Psychotherapy, Philipps-Universität Marburg, Marburg, Germany.
Eva-Lotta BrakemeierDepartment of Clinical Psychology and Psychotherapy, Philipps-Universität Marburg, Marburg, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveWhile the efficacy of psychotherapy in the treatment of mental disorders is well examined, systematic research into negative effects of psychotherapy seems comparatively rare. Therefore, this review evaluates instruments for assessing negative effects of psychotherapy in order to create a consensus framework and make recommendations for their assessment.

methodsThe study selection procedure follows current best-practice guidelines for conducting systematic reviews, with 10 included studies in three databases (PsycINFO, PubMed, and Web of Science). The nine instruments identified were each critically reviewed concerning the theoretical orientation, including the assessed domains of negative effects, psychometric properties, and diagnostic characteristics.

resultsSeventeen domains of negative effects of psychotherapy were identified but inconsistently assessed by the nine instruments. Most instruments provide some initial data on their psychometric properties. Regarding diagnostic characteristics, different item-response formats are used but often with reference to "attribution to therapy."

conclusionThis review indicates that the existing instruments for assessing negative effects of psychotherapy cover a wide range of relevant domains without any consensus on the most important ones and their psychometric properties are usually unsatisfactory. A framework for consensus, building on the definition and conceptualization of negative effects, is synthesized, and recommendations for improving the assessment are derived.

Indexed as

PsychotherapyHumansMental DisordersPsychometricsassessmentinstrumentsnegative effectspsychotherapyside effects

Identifiers

PMID31647202
PMCPMC6908878

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.