Evidence map›Paper›PMID 39893183›Full record

ArticleScientific data2025

Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasets.

Kumar Abhishek, Aditi Jain, Ghassan Hamarneh

Abstract readDataset
In one paragraph

Article in Scientific data, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Review
  2. Artificial Intelligence Research as a Continuous Clinical Service.Mayo Clinic proceedings. Digital health · 2026
    Review
  3. Mask of Truth: Model Sensitivity to Unexpected Regions of Medical Images.Journal of imaging informatics in medicine · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Kumar AbhishekSchool of Computing Science, Simon Fraser University, Burnaby, V5A 1S6, Canada. kabhishe@sfu.ca.ORCID http://orcid.org/0000-0002-7341-9617
Aditi JainDepartment of Mathematics, Indian Institute of Technology Delhi, New Delhi, 110016, India.ORCID https://orcid.org/0009-0004-0402-2300
Ghassan HamarnehSchool of Computing Science, Simon Fraser University, Burnaby, V5A 1S6, Canada.ORCID http://orcid.org/0000-0001-5040-7448

Funding

Gouvernement du Canada | Natural Sciences and Engineering Research Council of Canada (Conseil de Recherches en Sciences Naturelles et en Génie du Canada) RGPIN 06795
6 · The paper itself

Abstract

The remarkable progress of deep learning in dermatological tasks has brought us closer to achieving diagnostic accuracies comparable to those of human experts. However, while large datasets play a crucial role in the development of reliable deep neural network models, the quality of data therein and their correct usage are of paramount importance. Several factors can impact data quality, such as the presence of duplicates, data leakage across train-test partitions, mislabeled images, and the absence of a well-defined test partition. In this paper, we conduct meticulous analyses of three popular dermatological image datasets: DermaMNIST, its source HAM10000, and Fitzpatrick17k, uncovering these data quality issues, measure the effects of these problems on the benchmark results, and propose corrections to the datasets. Besides ensuring the reproducibility of our analysis, by making our analysis pipeline and the accompanying code publicly available, we aim to encourage similar explorations and to facilitate the identification and addressing of potential data quality issues in other large datasets.

Indexed as

Data AccuracyDermatologySkinDeep LearningHumans

Identifiers

PMID39893183
PMCPMC11787307

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.