Evidence map›Paper›PMID 33037709›Full record

ArticleJournal of the European Academy of Dermatology and Venereology : JEADV2021

Performance of a deep neural network in teledermatology: a single-centre prospective diagnostic study.

C Muñoz-López, C Ramírez-Cornejo, M A Marchetti, S S Han, P Del Barrio-Díaz, A Jaque, P Uribe, D Majerson, M Curi, C Del Puerto and 10 more

Open access · greenAbstract read
In one paragraph

Article in Journal of the European Academy of Dermatology and Venereology : JEADV, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed, 2 pooled it
2.8field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed, 2 syntheses or guidelines pooled it, 65 citations in OpenAlex.

  1. Pooled it
  2. Natural language processing in dermatology: A systematic literature review and state of the art.Journal of the European Academy of Dermatology and Venereology : JEADV · 2024
    Pooled it
  3. Perilesional sun damage as a diagnostic clue for pigmented actinic keratosis and Bowen's disease.Journal of the European Academy of Dermatology and Venereology : JEADV · 2021
    Trial
  4. Review
  5. Article
  6. Article
  7. Article
  8. Review
  9. Review
  10. Review
  11. Review
  12. Review
  13. Article
  14. Artificial intelligence and skin cancer.Frontiers in medicine · 2024
    Review
  15. Review of Teledermatology: Lessons Learned from the COVID-19 Pandemic.American journal of clinical dermatology · 2024
    Review
  16. Article
  17. Review
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

20 authors at 4 institutions in 4 countries.

C Muñoz-LópezDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
C Ramírez-CornejoDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
M A MarchettiDermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
S S HanDermatology Clinic, Seoul, Korea.
P Del Barrio-DíazDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
A JaqueDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
P UribeDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
D MajersonDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
M CuriDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
C Del PuertoDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.ORCID https://orcid.org/0000-0003-4667-1873
F Reyes-BaraonaDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
R Meza-RomeroDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.ORCID https://orcid.org/0000-0003-3863-4386
J Parra-CaresDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
P Araneda-OrtegaDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
M GuzmánDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
R Millán-ApablazaDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
M Nuñez-MoraDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
K LiopyrisDepartment of Dermatology, University of Athens, Andreas Syggros Hospital of Skin and Venereal Diseases, Athens, Greece.ORCID https://orcid.org/0000-0001-9566-8238
C Vera-KelletDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
C Navarrete-DechentDepartment of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.ORCID https://orcid.org/0000-0003-4040-3640
Pontificia Universidad Católica de Chile · CLDr Youth Clinic · KRMemorial Sloan Kettering Cancer Center · USNational and Kapodistrian University of Athens · GR

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
NCI NIH HHS P30 CA008748
6 · The paper itself

Abstract

backgroundThe use of artificial intelligence (AI) algorithms for the diagnosis of skin diseases has shown promise in experimental settings but has not been yet tested in real-life conditions.

objectiveTo assess the diagnostic performance and potential clinical utility of a 174-multiclass AI algorithm in a real-life telemedicine setting.

methodsProspective, diagnostic accuracy study including consecutive patients who submitted images for teledermatology evaluation. The treating dermatologist chose a single image to upload to a web application during teleconsultation. A follow-up reader study including nine healthcare providers (3 dermatologists, 3 dermatology residents and 3 general practitioners) was performed.

resultsA total of 340 cases from 281 patients met study inclusion criteria. The mean (SD) age of patients was 33.7 (17.5) years; 63% (n = 177) were female. Exposure to the AI algorithm results was considered useful in 11.8% of visits (n = 40) and the teledermatologist correctly modified the real-time diagnosis in 0.6% (n = 2) of cases. The overall top-1 accuracy of the algorithm (41.2%) was lower than that of the dermatologists (60.1%), residents (57.8%) and general practitioners (49.3%) (all comparisons P < 0.05, in the reader study). When the analysis was limited to the diagnoses on which the algorithm had been explicitly trained, the balanced top-1 accuracy of the algorithm (47.6%) was comparable to the dermatologists (49.7%) and residents (47.7%) but superior to the general practitioners (39.7%; P = 0.049). Algorithm performance was associated with patient skin type and image quality.

conclusionsA 174-disease class AI algorithm appears to be a promising tool in the triage and evaluation of lesions with patient-taken photographs via telemedicine.

Indexed as

DermatologySkin DiseasesTelemedicineAdultArtificial IntelligenceFemaleHumansMaleNeural Networks, ComputerProspective Studies

Identifiers

PMID33037709
PMCPMC8274350
OpenAlexW3092516577

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.