Evidence map›Paper›PMID 41429926›Full record

ArticleNPJ digital medicine2025

Evaluating skin tone scales for dermatologic dataset labeling: a prospective-comparative study.

Vanessa R Weir, Yingjoy Li, Maura C Gillis, Nicholas R Kurtansky, Trina Salvador, Allan C Halpern, Kelly C Nelson, Jenna C Lester, Veronica Rotemberg

Abstract read
In one paragraph

Article in NPJ digital medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Vanessa R Weir *Dermatology Service, Division of Subspecialty Medicine, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Yingjoy Li *Dermatology Service, Division of Subspecialty Medicine, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Maura C GillisDermatology Service, Division of Subspecialty Medicine, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Nicholas R KurtanskyDermatology Service, Division of Subspecialty Medicine, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Trina SalvadorDermatology Service, Division of Subspecialty Medicine, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Allan C HalpernDermatology Service, Division of Subspecialty Medicine, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Kelly C NelsonDepartment of Dermatology, Division of Internal Medicine, University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Jenna C LesterDepartment of Dermatology, University of California, San Francisco, San Francisco, CA, USA.
Veronica RotembergDermatology Service, Division of Subspecialty Medicine, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA. rotembev@mskcc.org.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI SELWYN M VICKERS · 1985 to 2026
$347.4M
M-ISIC: A Multimodal Open-Source International Skin Imaging Collaboration Informatics Platform for Automated Skin Cancer DetectionU24CA264369 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI Kivanc Kose, Veronica Miriam Rotemberg · 2022 to 2026
$3.9M
Practical Randomized Controlled Trial of Artificial Intelligence for Melanoma Diagnosis (PRACTA-MEL)R01CA293974 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI Veronica Miriam Rotemberg · 2025 to 2026
$1.4M
NCI NIH HHS P30 CA008748NCI NIH HHS R01 CA293974NCI NIH HHS U24 CA264369
6 · The paper itself

Abstract

Skin tone affects artificial intelligence (AI) performance in dermatology. While labeling datasets for skin tone could improve algorithm generalizability for detecting dermatologic malignancies, large-scale validation of skin tone assessments is lacking. This prospective observational study assessed reliability of subjective tools (Fitzpatrick Skin Type [FST], Monk Skin Tone [MST], Pantone SkinTone Guide) and an objective colorimeter for in-person and photography-based settings to evaluate utility for labeling dermoscopic datasets. Colorimetry (gold standard for color measurement) demonstrated high precision with in-person measurements. Of subjective scales, MST demonstrated slightly tighter clustering in the color space and high repeatability for in-person and photography-based assessments (latter varied by lighting). Dermoscopic image-extracted color values correlated poorly with colorimetry values. For subjective ratings, MST more effectively captured differences in AI melanoma classification scores than FST. Findings underscore that FST is not a proxy for skin tone; an important role remains for skin tone assessment to improve AI performance.

Identifiers

PMID41429926
PMCPMC12749783

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.