Evidence map›Paper›PMID 28965089›Full record

SynthesisBMJ open2017

Are there researcher allegiance effects in diagnostic validation studies of the PHQ-9? A systematic review and meta-analysis.

Laura Manea, Jan Rasmus Boehnke, Simon Gilbody, Andrew S Moriarty, Dean McMillan

Abstract readMeta-AnalysisSystematic Review
In one paragraph

Synthesis in BMJ open, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Laura ManeaDeparment of Health Sciences, University of York, York, UK.ORCID http://orcid.org/0000-0002-0906-7362
Jan Rasmus BoehnkeDundee Centre for Health And Related Research, University of Dundee, Dundee, United Kingdom.
Simon GilbodyDeparment of Health Sciences, University of York, York, UK.
Andrew S MoriartyHull York Medical School, University of York, York, United Kingdom.
Dean McMillanDeparment of Health Sciences, University of York, York, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo investigate whether an authorship effect is found that leads to better performance in studies conducted by the original developers of the Patient Health Questionnaire (PHQ-9) (allegiant studies).

designSystematic review with random effects bivariate diagnostic meta-analysis. Search strategies included electronic databases, examination of reference lists and forward citation searches. INCLUSION CRITERIA: Included studies provided sufficient data to calculate the diagnostic accuracy of the PHQ-9 against a gold standard diagnosis of major depression using the algorithm or the summed item scoring method at cut-off point 10. DATA EXTRACTION: Descriptive information, methodological quality criteria and 2×2 contingency tables.

resultsSeven allegiant and 20 independent studies reported the diagnostic performance of the PHQ-9 using the algorithm scoring method. Pooled diagnostic OR (DOR) for the allegiant group was 64.40, and 15.05 for non-allegiant studies group. The allegiance status was a significant predictor of DOR variation (p<0.0001).Five allegiant studies and 26 non-allegiant studies reported the performance of the PHQ-9 at recommended cut-off point of 10. Pooled DOR for the allegiant group was 49.31, and 24.96 for the non-allegiant studies. The allegiance status was a significant predictor of DOR variation (p=0.015).Some potential alternative explanations for the observed authorship effect including differences in study characteristics and quality were found, although it is not clear how some of them account for the observed differences.

conclusionsAllegiant studies reported better performance of the PHQ-9. Allegiance status was predictive of variation in the DOR. Based on the observed differences between independent and non-independent studies, we were unable to conclude or exclude that allegiance effects are present in studies examining the diagnostic performance of the PHQ-9. This study highlights the need for future meta-analyses of diagnostic validation studies of psychological measures to evaluate the impact of researcher allegiance in the primary studies.

Indexed as

AuthorshipBiasResearch PersonnelAlgorithmsHumansPatient Health QuestionnaireResearch Designallegiance effectdiagnostic meta-analysisPhq-9screening

Identifiers

PMID28965089
PMCPMC5640143

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.