Evidence map›Paper›PMID 33978306›Full record

SynthesisInternational journal of methods in psychiatric research2021

Selective cutoff reporting in studies of the accuracy of the Patient Health Questionnaire-9 and Edinburgh Postnatal Depression Scale: Comparison of results based on published cutoffs versus all cutoffs using individual participant data meta-analysis.

Dipika Neupane, Brooke Levis, Parash M Bhandari, Brett D Thombs, Andrea Benedetti, DEPRESsion Screening Data (DEPRESSD) Collaboration

Abstract readMeta-Analysis
In one paragraph

Synthesis in International journal of methods in psychiatric research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Dipika NeupaneLady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada.
Brooke LevisLady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada.
Parash M BhandariLady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada.
Brett D ThombsLady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada.ORCID 0000-0002-5644-8432
Andrea BenedettiDepartment of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada.ORCID 0000-0002-8314-9497
DEPRESsion Screening Data (DEPRESSD) Collaboration

Funding

Obesity and Energy Metabolism CoreP30DK050456 · NIDDK · UNIVERSITY OF MINNESOTA TWIN CITIES · PI JEFFERY, ROBERT W · 1995 to 2015
$17.0M
CDC Injury Control Research Center for Preventing Suicide (CDC ICRC S)R49CE002093 · CE · UNIVERSITY OF ROCHESTER · PI CAINE, ERIC D. · 2012 to 2018
$5.6M
Epidemiology of Depression and Heart Failure in AgingR01HL079235 · NHLBI · NORTHERN CALIFORNIA INSTITUTE RES &EDUC · PI WHOOLEY, MARY A · 2005 to 2009
$4.2M
University of Washington MHIRT Training Program GrantT37MD001449 · NIMHD · UNIVERSITY OF WASHINGTON · PI WILLIAMS, MICHELLE A. · 2005 to 2018
$3.5M
CONTROLLED TRIAL OF SERTRALINE FOR DEPRESSION AFTER TBIR01HD039415 · NICHD · UNIVERSITY OF WASHINGTON · PI BOMBARDIER, CHARLES HENRY · 2000 to 2004
$2.6M
IP-RISP: The Senior Health and Research AllianceR24MH071604 · NIMH · UNIVERSITY OF ROCHESTER · PI CONWELL, YEATES · 2006 to 2010
$2.5M
Postpartum Depression in a Pediatric ClinicK23MH064476 · NIMH · UNIVERSITY OF ROCHESTER · PI CHAUDRON, LINDA H · 2002 to 2006
$882k
THE TREATMENT OF EATING DISORDERSK02MH065919 · NIMH · UNIVERSITY OF MINNESOTA TWIN CITIES · PI CROW, SCOTT J · 2003 to 2007
$689k
Adaptation of a Depression Treatment Intervention for HIV Patients in CameroonR34MH084673 · NIMH · UNIV OF NORTH CAROLINA CHAPEL HILL · PI GAYNES, BRADLEY N · 2009 to 2011
$627k
Stepped Care Treatment of Postpartum DepressionR34MH072925 · NIMH · UNIVERSITY OF MINNESOTA TWIN CITIES · PI GJERDINGEN, DWENDA K. · 2005 to 2007
$489k
Psychosocial Barriers to Engagement in Care in Young South African Women with HIVF30MH096664 · NIMH · UNIV OF NORTH CAROLINA CHAPEL HILL · PI CHOLERA, RUSHINA · 2011 to 2015
$143k
NCIPC CDC HHS R49 CE002093NHLBI NIH HHS R01 HL079235NICHD NIH HHS R01 HD039415NIDDK NIH HHS P30 DK050456NIMHD NIH HHS T37 MD001449NIMH NIH HHS F30 MH096664NIMH NIH HHS K02 MH065919NIMH NIH HHS K23 MH064476NIMH NIH HHS R24 MH071604NIMH NIH HHS R34 MH072925NIMH NIH HHS R34 MH084673Wellcome Trust
6 · The paper itself

Abstract

objectivesSelectively reported results from only well-performing cutoffs in diagnostic accuracy studies may bias estimates in meta-analyses. We investigated cutoff reporting patterns for the Patient Health Questionnaire-9 (PHQ-9; standard cutoff 10) and Edinburgh Postnatal Depression Scale (EPDS; no standard cutoff, commonly used 10-13) and compared accuracy estimates based on published cutoffs versus all cutoffs.

methodsWe conducted bivariate random effects meta-analyses using individual participant data to compare accuracy from published versus all cutoffs.

resultsFor the PHQ-9 (30 studies, N = 11,773), published results underestimated sensitivity for cutoffs below 10 (median difference: -0.06) and overestimated for cutoffs above 10 (median difference: 0.07). EPDS (19 studies, N = 3637) sensitivity estimates from published results were similar for cutoffs below 10 (median difference: 0.00) but higher for cutoffs above 13 (median difference: 0.14). Specificity estimates from published and all cutoffs were similar for both tools. The mean cutoff of all reported cutoffs in PHQ-9 studies with optimal cutoff below 10 was 8.8 compared to 11.8 for those with optimal cutoffs above 10. Mean for EPDS studies with optimal cutoffs below 10 was 9.9 compared to 11.8 for those with optimal cutoffs greater than 10.

conclusionSelective cutoff reporting was more pronounced for the PHQ-9 than EPDS.

Indexed as

Major Depressive DisorderPatient Health QuestionnaireBiasHumansPsychiatric Status Rating ScalesSensitivity and Specificitydiagnostic test accuracyindividual participant data meta-analysismeta-analysispublication biasselective cutoff reporting

Identifiers

PMID33978306
PMCPMC8412225

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.