Evidence map›Paper›PMID 34780986›Full record

SynthesisMethods (San Diego, Calif.)2022

External validation of a shortened screening tool using individual participant data meta-analysis: A case study of the Patient Health Questionnaire-Dep-4.

Daphna Harel, Brooke Levis, Ying Sun, Felix Fischer, John P A Ioannidis, Pim Cuijpers, Scott B Patten, Roy C Ziegelstein, Sarah Markham, Andrea Benedetti and 2 more

Abstract readMeta-Analysis
In one paragraph

Synthesis in Methods (San Diego, Calif.), 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Daphna HarelDepartment of Applied Statistics, Social Science, and Humanities, New York University, United States; Center for the Promotion of Research at the Intersection of Information, Society, and Methodology, New York University, United States. Electronic address: daphna.harel@nyu.edu.
Brooke LevisCentre for Prognosis Research, School of Medicine, Keele University, Staffordshire, United Kingdom.
Ying SunLady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada.
Felix FischerDepartment of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité -Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität Zu Berlin, and Berlin Institute of Health, Berlin, Germany.
John P A IoannidisDepartment of Medicine, Stanford University, Stanford, CA, USA; Department of Epidemiology and Population Health, Stanford University, Stanford, CA, USA; Department of Biomedical Data Science, Stanford University, Stanford, CA, USA; Department of Statistics, Stanford University, Stanford, CA, USA.
Pim CuijpersDepartment of Clinical, Neuro and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, the Netherlands.
Scott B PattenDepartment of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada.
Roy C ZiegelsteinDepartment of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
Sarah MarkhamDepartment of Biostatistics and Health Informatics, King's College London, London, UK.
Andrea BenedettiDepartment of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada; Department of Medicine, McGill University, Montréal, Québec, Canada; Respiratory Epidemiology and Clinical Research Unit, McGill University Health Centre, Montréal, Québec, Canada.
Brett D ThombsLady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada; Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada; Department of Medicine, McGill University, Montréal, Québec, Canada; Department of Psychiatry, McGill University, Montréal, Québec, Canada; Department of Psychology, McGill University, Montréal, Québec, Canada; Department of Educational and Counselling Psychology, McGill University, Montréal, Québec, Canada; Biomedical Ethics Unit, McGill University, Montréal, Québec, Canada.
DEPRESsion Screening Data DEPRESSD PHQ Collaboration

Funding

NRG Oncology Network Group Operations Center - GY9 BIQSFP Reports/BudgetsU10CA180868 · NCI · NRG ONCOLOGY FOUNDATION, INC. · PI NORMAN WOLMARK · 2014 to 2026
$206.8M
RTOG Foreign AccrualU10CA021661 · NCI · AMERICAN COLLEGE OF RADIOLOGY · PI CURRAN, WALTER J. · 1985 to 2013
$150.3M
Statistics CoreU10CA180822 · NCI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI James J. Dignam · 2014 to 2026
$146.4M
RTOG Foreign AccrualsU10CA037422 · NCI · AMERICAN COLLEGE OF RADIOLOGY · PI BRUNER, DEBORAH WATKINS · 1985 to 2013
$30.4M
PSYCHIATRIC EPIDEMIOLOGY TRAINING PROGRAMT32MH014592 · NIMH · JOHNS HOPKINS UNIVERSITY · PI HEATHER E VOLK, Peter P. Zandi · 1985 to 2026
$8.5M
Global Mental Health Training ProgramT32MH103210 · NIMH · JOHNS HOPKINS UNIVERSITY · PI Judith Karen Bass, Sarah Sutherlin-McIvor Murray · 2015 to 2026
$4.0M
University of Washington MHIRT Training Program GrantT37MD001449 · NIMHD · UNIVERSITY OF WASHINGTON · PI WILLIAMS, MICHELLE A. · 2005 to 2018
$3.5M
Terrorism and Traumatic Responding: Exposure and Resiliency FactorsR01MH073687 · NIMH · RUSH UNIVERSITY MEDICAL CENTER · PI HOBFOLL, STEVAN · 2006 to 2009
$2.2M
Psychophysiology, Neurosteroids, and Stress in Premenstrual Dysphoric Disorder (PMDD)K23MH107831 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI HANTSOO, LIISA VICTORIA · 2016 to 2020
$905k
Depression Screening &Treatment in Ovarian CancerK07CA093512 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI SHINN, EILEEN H · 2003 to 2007
$599k
NCI NIH HHS K07 CA093512NCI NIH HHS U10 CA021661NCI NIH HHS U10 CA037422NCI NIH HHS U10 CA180822NCI NIH HHS U10 CA180868NIMHD NIH HHS T37 MD001449NIMH NIH HHS K23 MH107831NIMH NIH HHS R01 MH073687NIMH NIH HHS T32 MH014592NIMH NIH HHS T32 MH103210
6 · The paper itself

Abstract

Shortened versions of self-reported questionnaires may be used to reduce respondent burden. When shortened screening tools are used, it is desirable to maintain equivalent diagnostic accuracy to full-length forms. This manuscript presents a case study that illustrates how external data and individual participant data meta-analysis can be used to assess the equivalence in diagnostic accuracy between a shortened and full-length form. This case study compares the Patient Health Questionnaire-9 (PHQ-9) and a 4-item shortened version (PHQ-Dep-4) that was previously developed using optimal test assembly methods. Using a large database of 75 primary studies (34,698 participants, 3,392 major depression cases), we evaluated whether the PHQ-Dep-4 cutoff of ≥ 4 maintained equivalent diagnostic accuracy to a PHQ-9 cutoff of ≥ 10. Using this external validation dataset, a PHQ-Dep-4 cutoff of ≥ 4 maximized the sum of sensitivity and specificity, with a sensitivity of 0.88 (95% CI 0.81, 0.93), 0.68 (95% CI 0.56, 0.78), and 0.80 (95% CI 0.73, 0.85) for the semi-structured, fully structured, and MINI reference standard categories, respectively, and a specificity of 0.79 (95% CI 0.74, 0.83), 0.85 (95% CI 0.78, 0.90), and 0.83 (95% CI 0.80, 0.86) for the semi-structured, fully structured, and MINI reference standard categories, respectively. While equivalence with a PHQ-9 cutoff of ≥ 10 was not established, we found the sensitivity of the PHQ-Dep-4 to be non-inferior to that of the PHQ-9, and the specificity of the PHQ-Dep-4 to be marginally smaller than the PHQ-9.

Indexed as

Major Depressive DisorderTool Use BehaviorHumansMass ScreeningPatient Health QuestionnaireReproducibility of ResultsSensitivity and SpecificityEquivalence testingOptimal test assemblySelf-report questionnaireSensitivitySpecificity

Identifiers

PMID34780986
PMCPMC11719774

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.