Evidence map›Paper›PMID 24588874›Full record

ArticleBMC medical research methodology2014

Incorporating quality assessments of primary studies in the conclusions of diagnostic accuracy reviews: a cross-sectional study.

Eleanor A Ochodo, Wynanda A van Enst, Christiana A Naaktgeboren, Joris A H de Groot, Lotty Hooft, Karel G M Moons, Johannes B Reitsma, Patrick M Bossuyt, Mariska M G Leeflang

Abstract read
In one paragraph

Article in BMC medical research methodology, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Comparisons of the Computed Tomographic Scan and Panoramic Radiography Before Mandibular Third Molar Extraction Surgery.Medical science monitor : international medical journal of experimental and clinical research · 2018
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Eleanor A OchodoDepartment of Clinical Epidemiology, Biostatistics & Bioinformatics, Academic Medical Center, University of Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands. eleanor.ochodo@gmail.com.
Wynanda A van Enst
Christiana A Naaktgeboren
Joris A H de Groot
Lotty Hooft
Karel G M Moons
Johannes B Reitsma
Patrick M Bossuyt
Mariska M G Leeflang

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDrawing conclusions from systematic reviews of test accuracy studies without considering the methodological quality (risk of bias) of included studies may lead to unwarranted optimism about the value of the test(s) under study. We sought to identify to what extent the results of quality assessment of included studies are incorporated in the conclusions of diagnostic accuracy reviews.

methodsWe searched MEDLINE and EMBASE for test accuracy reviews published between May and September 2012. We examined the abstracts and main texts of these reviews to see whether and how the results of quality assessment were linked to the accuracy estimates when drawing conclusions.

resultsWe included 65 reviews of which 53 contained a meta-analysis. Sixty articles (92%) had formally assessed the methodological quality of included studies, most often using the original QUADAS tool (n = 44, 68%). Quality assessment was mentioned in 28 abstracts (43%); with a majority (n = 21) mentioning it in the methods section. In only 5 abstracts (8%) were results of quality assessment incorporated in the conclusions. Thirteen reviews (20%) presented results of quality assessment in the main text only, without further discussion. Forty-seven reviews (72%) discussed results of quality assessment; the most frequent form was as limitations in assessing quality (n = 28). Only 6 reviews (9%) further linked the results of quality assessment to their conclusions, 3 of which did not conduct a meta-analysis due to limitations in the quality of included studies. In the reviews with a meta-analysis, 19 (36%) incorporated quality in the analysis. Eight reported significant effects of quality on the pooled estimates; in none of them these effects were factored in the conclusions.

conclusionWhile almost all recent diagnostic accuracy reviews evaluate the quality of included studies, very few consider results of quality assessment when drawing conclusions. The practice of reporting systematic reviews of test accuracy should improve if readers not only want to be informed about the limitations in the available evidence, but also on the associated implications for the performance of the evaluated tests.

Indexed as

Data Interpretation, StatisticalBiasCross-Sectional StudiesDiagnostic ErrorsDiagnostic Tests, RoutineHumansQuality Assurance, Health CareResearch DesignSensitivity and Specificity

Identifiers

PMID24588874
PMCPMC3942773

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.