Evidence map›Paper›PMID 22523263›Full record

ArticleClinical infectious diseases : an official publication of the Infectious Diseases Society of America2012

Fool's gold: Why imperfect reference tests are undermining the evaluation of novel diagnostics: a reevaluation of 5 diagnostic tests for leptospirosis.

Direk Limmathurotsakul, Elizabeth L Turner, Vanaporn Wuthiekanun, Janjira Thaipadungpanit, Yupin Suputtamongkol, Wirongrong Chierakul, Lee D Smythe, Nicholas P J Day, Ben Cooper, Sharon J Peacock

Open access · hybridAbstract readEvaluation Study
In one paragraph

Article in Clinical infectious diseases : an official publication of the Infectious Diseases Society of America, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 100 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
100citing papers in PubMed, 7 pooled it
12.5field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

100 citing papers in PubMed, 7 syntheses or guidelines pooled it, 214 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Rapid diagnostic test (Leptocheck-WB) for detection of acute leptospirosis: a meta-analysis of diagnostic accuracy.European journal of clinical microbiology & infectious diseases : official publication of the European Society of Clinical Microbiology · 2022
    Pooled it
  4. Nucleic acid and antigen detection tests for leptospirosis.The Cochrane database of systematic reviews · 2019
    Pooled it
  5. Diagnostic accuracy of leptospirosis whole-cell lateral flow assays: a systematic review and meta-analysis.Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases · 2019
    Pooled it
  6. Pooled it
  7. Pooled it
  8. Article
  9. Article
  10. Review
  11. Retrospective Molecular Detection and Characterization of PathogenicTropical medicine and infectious disease · 2026
    Article
  12. Addressing the burden of leptospirosis in Africa.Tropical diseases, travel medicine and vaccines · 2025
    Review
  13. Leptospirosis.Nature reviews. Disease primers · 2025
    Review
  14. Seroprevalence and carrier status ofIranian journal of veterinary research · 2025
    Article
  15. Article
  16. Serologically Confirmed Human Leptospirosis in Colombia, 2015-2020.The American journal of tropical medicine and hygiene · 2024
    Article
  17. Article
  18. Article
  19. Article
  20. Article

40 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 4 institutions in 3 countries.

Direk LimmathurotsakulDepartment of Tropical Hygiene, Faculty of Tropical Medicine, Siriraj Hospital, Mahidol University, Bangkok, Thailand. direk@tropmedres.ac
Elizabeth L Turner
Vanaporn Wuthiekanun
Janjira Thaipadungpanit
Yupin Suputtamongkol
Wirongrong Chierakul
Lee D Smythe
Nicholas P J Day
Ben Cooper
Sharon J Peacock
Mahidol Oxford Tropical Medicine Research Unit · THLondon School of Hygiene & Tropical Medicine · GBQueensland Health · AUSiriraj Hospital · TH

Funding

Wellcome Trust 089275Wellcome Trust 090219/Z/09/Z
6 · The paper itself

Abstract

backgroundWe observed that some patients with clinical leptospirosis supported by positive results of rapid tests were negative for leptospirosis on the basis of our diagnostic gold standard, which involves isolation of Leptospira species from blood culture and/or a positive result of a microscopic agglutination test (MAT). We hypothesized that our reference standard was imperfect and used statistical modeling to investigate this hypothesis.

methodsData for 1652 patients with suspected leptospirosis recruited during three observational studies and one randomized control trial that described the application of culture, MAT, immunofluorescence assay (IFA), lateral flow (LF) and/or PCR targeting the 16S rRNA gene were reevaluated using Bayesian latent class models and random-effects meta-analysis.

resultsThe estimated sensitivities of culture alone, MAT alone, and culture plus MAT (for which the result was considered positive if one or both tests had a positive result) were 10.5% (95% credible interval [CrI], 2.7%-27.5%), 49.8% (95% CrI, 37.6%-60.8%), and 55.5% (95% CrI, 42.9%-67.7%), respectively. These low sensitivities were present across all 4 studies. The estimated specificity of MAT alone (and of culture plus MAT) was 98.8% (95% CrI, 92.8%-100.0%). The estimated sensitivities and specificities of PCR (52.7% [95% CrI, 45.2%-60.6%] and 97.2% [95% CrI, 92.0%-99.8%], respectively), lateral flow test (85.6% [95% CrI, 77.5%-93.2%] and 96.2% [95% CrI, 87.7%-99.8%], respectively), and immunofluorescence assay (45.5% [95% CrI, 33.3%-60.9%] and 96.8% [95% CrI, 92.8%-99.8%], respectively) were considerably different from estimates in which culture plus MAT was considered a perfect gold standard test.

conclusionsOur findings show that culture plus MAT is an imperfect gold standard against which to compare alterative tests for the diagnosis of leptospirosis. Rapid point-of-care tests for this infection would bring an important improvement in patient care, but their future evaluation will require careful consideration of the reference test(s) used and the inclusion of appropriate statistical models.

Indexed as

Reference StandardsAdolescentAdultDiagnostic ErrorsDiagnostic Tests, RoutineHumansLeptospiraLeptospirosisMicroscopyModels, StatisticalRandomized Controlled Trials as TopicYoung Adult

Identifiers

PMID22523263
PMCPMC3393707
OpenAlexW2158445955

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.