Evidence map›Paper›PMID 38594408›Full record

ReviewNPJ digital medicine2024

Human-AI interaction in skin cancer diagnosis: a systematic review and meta-analysis.

Isabelle Krakowski, Jiyeong Kim, Zhuo Ran Cai, Roxana Daneshjou, Jan Lapins, Hanna Eriksson, Anastasia Lykou, Eleni Linos

Open access · goldAbstract readReview
In one paragraph

Review in NPJ digital medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 3 pooled it
15.3field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 3 syntheses or guidelines pooled it, 54 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Natural language processing in dermatology: A systematic literature review and state of the art.Journal of the European Academy of Dermatology and Venereology : JEADV · 2024
    Pooled it
  4. Article
  5. Review
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 7 institutions in 3 countries.

Isabelle KrakowskiCenter for Digital Health, Stanford University School of Medicine, Stanford, CA, USA.
Jiyeong KimCenter for Digital Health, Stanford University School of Medicine, Stanford, CA, USA.ORCID http://orcid.org/0000-0002-2869-5751
Zhuo Ran CaiCenter for Digital Health, Stanford University School of Medicine, Stanford, CA, USA.
Roxana DaneshjouDepartment of Dermatology, Department of Biomedical Data Science, Stanford School of Medicine, Stanford, CA, USA.ORCID http://orcid.org/0000-0001-7988-9356
Jan LapinsDepartment of Dermatology, Theme Inflammation, Karolinska University Hospital, Stockholm, Sweden.
Hanna ErikssonDepartment of Oncology and Pathology, Karolinska Institutet, Stockholm, Sweden.
Anastasia LykouDepartment of Education, University of Nicosia, Nicosia, Cyprus.
Eleni LinosCenter for Digital Health, Stanford University School of Medicine, Stanford, CA, USA. linos@stanford.edu.ORCID http://orcid.org/0000-0002-5856-6301
Stanford University · USKarolinska Institutet · SEKarolinska University Hospital · SESkin Cancer Foundation · USStanford Health Care · USStanford Medicine · USUniversity of Nicosia · CY

Funding

Patient Oriented Research in Vulnerable Populations with Skin DiseaseK24AR075060 · NIAMS · STANFORD UNIVERSITY · PI Eleni Linos · 2019 to 2026
$1.6M
Novel digital tools for home-based monitoring of skin diseaseR01AR082109 · NIAMS · STANFORD UNIVERSITY · PI Eleni Linos · 2023 to 2026
$629k
NIAMS NIH HHS K24 AR075060NIAMS NIH HHS R01 AR082109
6 · The paper itself

Abstract

The development of diagnostic tools for skin cancer based on artificial intelligence (AI) is increasing rapidly and will likely soon be widely implemented in clinical use. Even though the performance of these algorithms is promising in theory, there is limited evidence on the impact of AI assistance on human diagnostic decisions. Therefore, the aim of this systematic review and meta-analysis was to study the effect of AI assistance on the accuracy of skin cancer diagnosis. We searched PubMed, Embase, IEE Xplore, Scopus and conference proceedings for articles from 1/1/2017 to 11/8/2022. We included studies comparing the performance of clinicians diagnosing at least one skin cancer with and without deep learning-based AI assistance. Summary estimates of sensitivity and specificity of diagnostic accuracy with versus without AI assistance were computed using a bivariate random effects model. We identified 2983 studies, of which ten were eligible for meta-analysis. For clinicians without AI assistance, pooled sensitivity was 74.8% (95% CI 68.6-80.1) and specificity was 81.5% (95% CI 73.9-87.3). For AI-assisted clinicians, the overall sensitivity was 81.1% (95% CI 74.4-86.5) and specificity was 86.1% (95% CI 79.2-90.9). AI benefitted medical professionals of all experience levels in subgroup analyses, with the largest improvement among non-dermatologists. No publication bias was detected, and sensitivity analysis revealed that the findings were robust. AI in the hands of clinicians has the potential to improve diagnostic accuracy in skin cancer diagnosis. Given that most studies were conducted in experimental settings, we encourage future studies to further investigate these potential benefits in real-life settings.

Identifiers

PMID38594408
PMCPMC11004168
OpenAlexW4394620240

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.