Evidence map›Paper›PMID 16799124›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA

Advancing biomedical image retrieval: development and analysis of a test collection.

William R Hersh, Henning Müller, Jeffery R Jensen, Jianji Yang, Paul N Gorman, Patrick Ruch

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Trial
  2. Article
  3. Towards the creation of a visual ontology of biomedical imaging entities.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2012
    Article
  4. Article
  5. Article
  6. Annotation and retrieval of clinically relevant images.International journal of medical informatics · 2009
    Article
  7. Review
  8. Article
  9. Natural Language Processing Versus Content-Based Image Analysis for Medical Document Retrieval.Journal of the American Society for Information Science and Technology : JASIST · 2008
    Article
  10. Article
  11. Identifying patient smoking status from medical discharge records.Journal of the American Medical Informatics Association : JAMIA
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

William R HershDepartment of Medical Informatics & Clinical Epidemiology, Oregon Health & Science University, BICC, Portland, OR 97239, USA. hersh@ohsu.edu
Henning Müller
Jeffery R Jensen
Jianji Yang
Paul N Gorman
Patrick Ruch

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveDevelop and analyze results from an image retrieval test collection.

methodsAfter participating research groups obtained and assessed results from their systems in the image retrieval task of Cross-Language Evaluation Forum, we assessed the results for common themes and trends. In addition to overall performance, results were analyzed on the basis of topic categories (those most amenable to visual, textual, or mixed approaches) and run categories (those employing queries entered by automated or manual means as well as those using visual, textual, or mixed indexing and retrieval methods). We also assessed results on the different topics and compared the impact of duplicate relevance judgments.

resultsA total of 13 research groups participated. Analysis was limited to the best run submitted by each group in each run category. The best results were obtained by systems that combined visual and textual methods. There was substantial variation in performance across topics. Systems employing textual methods were more resilient to visually oriented topics than those using visual methods were to textually oriented topics. The primary performance measure of mean average precision (MAP) was not necessarily associated with other measures, including those possibly more pertinent to real users, such as precision at 10 or 30 images.

conclusionsWe developed a test collection amenable to assessing visual and textual methods for image retrieval. Future work must focus on how varying topic and run types affect retrieval performance. Users' studies also are necessary to determine the best measures for evaluating the efficacy of image retrieval systems.

Indexed as

Databases, FactualDiagnostic ImagingAbstracting and IndexingAnalysis of VarianceHumansInformation Storage and Retrieval

Identifiers

PMID16799124
PMCPMC1561788

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.