Evidence map›Paper›PMID 37501017›Full record

ArticleNature medicine2023

A reinforcement learning model for AI-based decision support in skin cancer.

Catarina Barata, Veronica Rotemberg, Noel C F Codella, Philipp Tschandl, Christoph Rinner, Bengu Nisa Akay, Zoe Apalla, Giuseppe Argenziano, Allan Halpern, Aimilios Lallas and 7 more

Abstract read
In one paragraph

Article in Nature medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 39 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Artificial Intelligence in Dermatology: New Regulatory Aspects After the European AI Act.Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging (ISSI) · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Precision medicine in cutaneous melanoma-A comprehensive review.Journal of the European Academy of Dermatology and Venereology : JEADV · 2026
    Review
  8. Article
  9. Review
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Cutaneous melanoma.Nature reviews. Disease primers · 2025
    Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Catarina Barata *Institute for Systems and Robotics, LARSyS, Instituto Superior Técnico, Lisbon, Portugal.ORCID http://orcid.org/0000-0002-2852-7723
Veronica Rotemberg *Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Noel C F CodellaMicrosoft, Redmond, WA, USA.
Philipp TschandlDepartment of Dermatology, Medical University of Vienna, Vienna, Austria.ORCID http://orcid.org/0000-0003-0391-7810
Christoph RinnerCenter for Medical Statistics, Informatics and Intelligent Systems (CeMSIIS), Medical University of Vienna, Vienna, Austria.ORCID http://orcid.org/0000-0002-3847-5664
Bengu Nisa AkayAnkara University School of Medicine, Department of Dermatology, Ankara, Turkey.ORCID http://orcid.org/0000-0002-4896-1666
Zoe ApallaSecond Department of Dermatology, Aristotle University of Thessaloniki, Thessaloniki, Greece.
Giuseppe ArgenzianoDermatology Unit, University of Campania, Naples, Italy.ORCID http://orcid.org/0000-0003-1413-8214
Allan HalpernDermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Aimilios LallasSecond Department of Dermatology, Aristotle University of Thessaloniki, Thessaloniki, Greece.
Caterina LongoDermatology Unit, University of Modena and Reggio Emilia, Modena, Italy.
Josep MalvehyMelanoma Unit, Dermatology Department, Hospital Clínic Barcelona, Universitat de Barcelona, IDIBAPS, Barcelona, Spain.
Susana PuigMelanoma Unit, Dermatology Department, Hospital Clínic Barcelona, Universitat de Barcelona, IDIBAPS, Barcelona, Spain.ORCID http://orcid.org/0000-0003-1337-9745
Cliff RosendahlGeneral Practice Clinical Unit, Medical School, The University of Queensland, Brisbane, Queensland, Australia.ORCID http://orcid.org/0000-0001-5182-2969
H Peter SoyerFrazer Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia.
Iris ZalaudekDepartment of Dermatology, Medical University of Trieste, Trieste, Italy.
Harald KittlerDepartment of Dermatology, Medical University of Vienna, Vienna, Austria. harald.kittler@meduniwien.ac.at.ORCID http://orcid.org/0000-0002-0051-8016

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
M-ISIC: A Multimodal Open-Source International Skin Imaging Collaboration Informatics Platform for Automated Skin Cancer DetectionU24CA264369 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI Kivanc Kose, Veronica Miriam Rotemberg · 2022 to 2026
$3.9M
NCI NIH HHS P30 CA008748NCI NIH HHS U24 CA264369
6 · The paper itself

Abstract

We investigated whether human preferences hold the potential to improve diagnostic artificial intelligence (AI)-based decision support using skin cancer diagnosis as a use case. We utilized nonuniform rewards and penalties based on expert-generated tables, balancing the benefits and harms of various diagnostic errors, which were applied using reinforcement learning. Compared with supervised learning, the reinforcement learning model improved the sensitivity for melanoma from 61.4% to 79.5% (95% confidence interval (CI): 73.5-85.6%) and for basal cell carcinoma from 79.4% to 87.1% (95% CI: 80.3-93.9%). AI overconfidence was also reduced while simultaneously maintaining accuracy. Reinforcement learning increased the rate of correct diagnoses made by dermatologists by 12.0% (95% CI: 8.8-15.1%) and improved the rate of optimal management decisions from 57.4% to 65.3% (95% CI: 61.7-68.9%). We further demonstrated that the reward-adjusted reinforcement learning model and a threshold-based model outperformed naïve supervised learning in various clinical scenarios. Our findings suggest the potential for incorporating human preferences into image-based diagnostic algorithms.

Indexed as

Basal Cell CarcinomaMelanomaSkin NeoplasmsAlgorithmsArtificial IntelligenceHumans

Identifiers

PMID37501017
PMCPMC10427421

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.