Evidence map›Paper›PMID 29854569›Full record

ArticleIEEE Applied Imagery Pattern Recognition Workshop : [proceedings]. IEEE Applied Imagery Pattern Recognition Workshop2016

The National Library of Medicine Pill Image Recognition Challenge: An Initial Report.

Ziv Yaniv, Jessica Faruque, Sally Howe, Kathel Dunn, David Sharlip, Andrew Bond, Pablo Perillan, Olivier Bodenreider, Michael J Ackerman, Terry S Yoo

Abstract read
In one paragraph

Article in IEEE Applied Imagery Pattern Recognition Workshop : [proceedings]. IEEE Applied Imagery Pattern Recognition Workshop, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. AI-Based Automation for Medication Reconciliation: Scoping Review.Journal of medical Internet research · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Comparison of RetinaNet, SSD, and YOLO v3 for real-time pill identification.BMC medical informatics and decision making · 2021
    Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Ziv YanivNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Jessica FaruqueNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Sally HoweNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Kathel DunnNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
David SharlipNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Andrew BondMedicos Consultants LLC, Baltimore, MD, USA.
Pablo PerillanMedicos Consultants LLC, Baltimore, MD, USA.
Olivier BodenreiderNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Michael J AckermanNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Terry S YooNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.

Funding

Intramural NIH HHS Z99 LM999999
6 · The paper itself

Abstract

In January 2016 the U.S. National Library of Medicine announced a challenge competition calling for the development and discovery of high-quality algorithms and software that rank how well consumer images of prescription pills match reference images of pills in its authoritative RxIMAGE collection. This challenge was motivated by the need to easily identify unknown prescription pills both by healthcare personnel and the general public. Potential benefits of this capability include confirmation of the pill in settings where the documentation and medication have been separated, such as in a disaster or emergency; and confirmation of a pill when the prescribed medication changes from brand to generic, or for any other reason the shape and color of the pill change. The data for the competition consisted of two types of images, high quality macro photographs, reference images, and consumer quality photographs of the quality we expect users of a proposed application to acquire. A training dataset consisting of 2000 reference images and 5000 corresponding consumer quality images acquired from 1000 pills was provided to challenge participants. A second dataset acquired from 1000 pills with similar distributions of shape and color was reserved as a segregated testing set. Challenge submissions were required to produce a ranking of the reference images, given a consumer quality image as input. Determination of the winning teams was done using the mean average precision quality metric, with the three winners obtaining mean average precision scores of 0.27, 0.09, and 0.08. In the retrieval results, the correct image was amongst the top five ranked images 43%, 12%, and 11% of the time, out of 5000 query/consumer images. This is an initial promising step towards development of an NLM software system and application-programming interface facilitating pill identification. The training dataset will continue to be freely available online at: http://pir.nlm.nih.gov/challenge/submission.html.

Indexed as

content-based image retrievalimage matchingopen dataprescription pill images

Identifiers

PMID29854569
PMCPMC5973812

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.