Evidence map›Paper›PMID 26220870›Full record

SynthesisBMJ open2015

How well do health professionals interpret diagnostic information? A systematic review.

Penny F Whiting, Clare Davenport, Catherine Jameson, Margaret Burke, Jonathan A C Sterne, Chris Hyde, Yoav Ben-Shlomo

Abstract readSystematic Review
In one paragraph

Synthesis in BMJ open, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 46 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
46citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

46 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Penny F WhitingSchool of Social and Community Medicine, University of Bristol, Bristol, UK The National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West at University Hospitals Bristol NHS Foundation Trust.
Clare DavenportUnit of Public Health, Epidemiology and Biostatistics, School of Health and Population Sciences, College of Medical and Dental Sciences, University of Birmingham, Edgbaston, Birmingham, UK.
Catherine JamesonSchool of Social and Community Medicine, University of Bristol, Bristol, UK.
Margaret BurkeSchool of Social and Community Medicine, University of Bristol, Bristol, UK.
Jonathan A C SterneSchool of Social and Community Medicine, University of Bristol, Bristol, UK.
Chris HydePeninsula Technology Assessment Group, Peninsula College of Medicine & Dentistry, Exeter, UK.
Yoav Ben-ShlomoSchool of Social and Community Medicine, University of Bristol, Bristol, UK.

Funding

Medical Research Council G0801405
6 · The paper itself

Abstract

objectiveTo evaluate whether clinicians differ in how they evaluate and interpret diagnostic test information.

designSystematic review. DATA SOURCES: MEDLINE, EMBASE and PsycINFO from inception to September 2013; bibliographies of retrieved studies, experts and citation search of key included studies. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: Primary studies that provided information on the accuracy of any diagnostic test (eg, sensitivity, specificity, likelihood ratios) to health professionals and that reported outcomes relating to their understanding of information on or implications of test accuracy.

resultsWe included 24 studies. 6 assessed ability to define accuracy metrics: health professionals were less likely to identify the correct definition of likelihood ratios than of sensitivity and specificity. -25 studies assessed Bayesian reasoning. Most assessed the influence of a positive test result on the probability of disease: they generally found health professionals' estimation of post-test probability to be poor, with a tendency to overestimation. 3 studies found that approaches based on likelihood ratios resulted in more accurate estimates of post-test probability than approaches based on estimates of sensitivity and specificity alone, while 3 found less accurate estimates. 5 studies found that presenting natural frequencies rather than probabilities improved post-test probability estimation and speed of calculations.

conclusionsCommonly used measures of test accuracy are poorly understood by health professionals. Reporting test accuracy using natural frequencies and visual aids may facilitate improved understanding and better estimation of the post-test probability of disease.

Indexed as

Clinical CompetenceData Interpretation, StatisticalHealth PersonnelBayes TheoremDiagnostic Techniques and ProceduresHumansLikelihood FunctionsSensitivity and SpecificityEPIDEMIOLOGYMEDICAL EDUCATION & TRAININGSTATISTICS & RESEARCH METHODS

Identifiers

PMID26220870
PMCPMC4521525

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.