Evidence map›Paper›PMID 35960806›Full record

ArticleScience advances2022

Disparities in dermatology AI performance on a diverse, curated clinical image set.

Roxana Daneshjou, Kailas Vodrahalli, Roberto A Novoa, Melissa Jenkins, Weixin Liang, Veronica Rotemberg, Justin Ko, Susan M Swetter, Elizabeth E Bailey, Olivier Gevaert and 9 more

Abstract read
In one paragraph

Article in Science advances, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 195 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
195citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

195 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Diagnosis melanoma with artificial intelligence systems: A meta-analysis study and systematic review.Journal of the European Academy of Dermatology and Venereology : JEADV · 2025
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Trial
  9. Article
  10. Article
  11. Addressing Health Disparities through Community Engagement in Artificial Intelligence-Driven Prevention Science.Prevention science : the official journal of the Society for Prevention Research · 2026
    Review
  12. Review
  13. Review
  14. Review
  15. Article
  16. Artificial Intelligence in Infectious Diseases and Clinical Microbiology.Infectious diseases & clinical microbiology · 2026
    Review
  17. Review
  18. Artificial intelligence in dermatology: A literature review of current evidence and clinical implementation.JID innovations : skin science from molecules to population health · 2026
    Review
  19. Review
  20. Review

135 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors.

Roxana DaneshjouDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.ORCID 0000-0001-7988-9356
Kailas VodrahalliDepartment of Electrical Engineering, Stanford University, Stanford, CA, USA.ORCID 0000-0002-9849-3055
Roberto A NovoaDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.
Melissa JenkinsDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.
Weixin LiangDepartment of Computer Science, Stanford University, Stanford, CA, USA.
Veronica RotembergDermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA.ORCID 0000-0003-0639-2677
Justin KoDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.
Susan M SwetterDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.ORCID 0000-0003-2098-2948
Elizabeth E BaileyDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.
Olivier GevaertDepartment of Biomedical Data Science, Stanford School of Medicine, Stanford, CA, USA.ORCID 0000-0002-9965-5466
Pritam MukherjeeDepartment of Biomedical Data Science, Stanford School of Medicine, Stanford, CA, USA.ORCID 0000-0002-9975-9994
Michelle PhungDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.
Kiana YekrangDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.ORCID 0000-0003-0714-5360
Bradley FongDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.
Rachna SahasrabudheDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.ORCID 0000-0003-0019-3554
Johan A C AllerupDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.ORCID 0000-0002-1517-2505
Utako Okata-KariganeDepartment of Dermatology, Keio University School of Medicine, Tokyo, Japan.ORCID 0000-0003-0540-1711
James ZouDepartment of Biomedical Data Science, Stanford School of Medicine, Stanford, CA, USA.
Albert S ChiouDepartment of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.ORCID 0000-0002-8436-0008

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
Postgraduate Training Program in Epithelial BiologyT32AR007422 · NIAMS · STANFORD UNIVERSITY · PI PAUL KHAVARI · 1986 to 2026
$5.0M
NCI NIH HHS P30 CA008748NIAMS NIH HHS T32 AR007422
6 · The paper itself

Abstract

An estimated 3 billion people lack access to dermatological care globally. Artificial intelligence (AI) may aid in triaging skin diseases and identifying malignancies. However, most AI models have not been assessed on images of diverse skin tones or uncommon diseases. Thus, we created the Diverse Dermatology Images (DDI) dataset-the first publicly available, expertly curated, and pathologically confirmed image dataset with diverse skin tones. We show that state-of-the-art dermatology AI models exhibit substantial limitations on the DDI dataset, particularly on dark skin tones and uncommon diseases. We find that dermatologists, who often label AI datasets, also perform worse on images of dark skin tones and uncommon diseases. Fine-tuning AI models on the DDI images closes the performance gap between light and dark skin tones. These findings identify important weaknesses and biases in dermatology AI that should be addressed for reliable application to diverse patients and diseases.

Identifiers

PMID35960806
PMCPMC9374341

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.