Evidence map›Paper›PMID 30443756›Full record

ArticleEuropean radiology2019

Citation bias in imaging research: are studies with higher diagnostic accuracy estimates cited more often?

Robert A Frank, Anahita Dehmoobad Sharifabadi, Jean-Paul Salameh, Trevor A McGrath, Noémie Kraaijpoel, Wilfred Dang, Nicole Li, Isabelle D Gauthier, Mark Z Wu, Patrick M Bossuyt and 2 more

Abstract read
PubMed Publisher
In one paragraph

Article in European radiology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. PSMA PET for primary lymph node staging of intermediate and high-risk prostate cancer: an expedited systematic review.Cancer imaging : the official publication of the International Cancer Imaging Society · 2020
    Pooled it
  2. Is There Evidence of P-Hacking in Imaging Research?Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes · 2023
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Robert A FrankFaculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
Anahita Dehmoobad SharifabadiFaculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
Jean-Paul SalamehDepartment of Radiology, University of Ottawa, Ottawa, ON, Canada.
Trevor A McGrathFaculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
Noémie KraaijpoelClinical Epidemiology and Biostatistics and Bioinformatics, Amsterdam Public Health Research Institute, Academic Medical Center, University of Amsterdam, Amsterdam, Netherlands.
Wilfred DangFaculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
Nicole LiFaculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
Isabelle D GauthierFaculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
Mark Z WuFaculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
Patrick M BossuytClinical Epidemiology and Biostatistics and Bioinformatics, Amsterdam Public Health Research Institute, Academic Medical Center, University of Amsterdam, Amsterdam, Netherlands.
Deborah LevineDepartment of Radiology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
Matthew D F McInnesDepartment of Radiology, University of Ottawa, Ottawa, ON, Canada. mmcinnes@toh.ca.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo assess the risk of citation bias in imaging diagnostic accuracy research by evaluating whether studies with higher accuracy estimates are cited more frequently than those with lower accuracy estimates.

methodsWe searched Medline for diagnostic accuracy meta-analyses published in imaging journals from January 2005 to April 2016. Primary studies from the meta-analyses were screened; those assessing the diagnostic accuracy of an imaging test and reporting sensitivity and specificity were eligible for inclusion. Studies not indexed in Web of Science, duplicates, and inaccessible articles were excluded. Topic (modality/subspecialty), study design, sample size, journal impact factor, publication date, times cited, sensitivity, and specificity were extracted for each study. Negative binomial regression was performed to evaluate the association of citation rate (times cited per month since publication) with Youden's index (sensitivity + specificity -1), highest sensitivity, and highest specificity, controlling for the potential confounding effects of modality, subspecialty, impact factor, study design, sample size, and source meta-analysis.

resultsThere were 1016 primary studies included. A positive association between Youden's index and citation rate was present, with a regression coefficient of 0.33 (p = 0.016). The regression coefficient for sensitivity was 0.41 (p = 0.034), and for specificity, 0.32 (p = 0.15).

conclusionA positive association exists between diagnostic accuracy estimates and citation rates, indicating that there is evidence of citation bias in imaging diagnostic accuracy literature. Overestimation of imaging test accuracy may contribute to patient harm from incorrect interpretation of test results. KEY POINTS: • Studies with higher accuracy estimates may be cited more frequently than those with lower accuracy estimates. • This citation bias could lead clinicians, reviews, and clinical practice guidelines to overestimate the accuracy of imaging tests, contributing to patient harm from incorrect interpretation of test results.

Indexed as

BibliometricsBiasDiagnostic ImagingHumansJournal Impact FactorMeta-Analysis as TopicResearch DesignSensitivity and SpecificityBibliometricsDiagnostic testPublication biasRoutineSensitivity and specificity

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.