Evidence map›Paper›PMID 31215969›Full record

ArticleJAMA dermatology2019

Accuracy of Computer-Aided Diagnosis of Melanoma: A Meta-analysis.

Vincent Dick, Christoph Sinz, Martina Mittlböck, Harald Kittler, Philipp Tschandl

Open access · bronzeAbstract read
In one paragraph

Article in JAMA dermatology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 44 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
44citing papers in PubMed, 6 pooled it
5.7field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

44 citing papers in PubMed, 6 syntheses or guidelines pooled it, 122 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Diagnostic accuracy of artificial intelligence models in detecting osteoporosis using dental images: a systematic review and meta-analysis.Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA · 2025
    Pooled it
  4. Pooled it
  5. Pooled it
  6. Application of artificial intelligence in diagnosis of osteoporosis using medical images: a systematic review and meta-analysis.Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA · 2021
    Pooled it
  7. Review
  8. Beyond black-box AI: Comparing ChatGPT-4 interpretability and accuracy to CNNs in melanocytic lesions diagnosis.Journal der Deutschen Dermatologischen Gesellschaft = Journal of the German Society of Dermatology : JDDG · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Review
  14. Review
  15. Review
  16. Article
  17. Article
  18. Skinly: A novel handheld IoT device for validating biophysical skin characteristics.Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging (ISSI) · 2024
    Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Vincent DickViDIR Group, Department of Dermatology, Medical University of Vienna, Vienna, Austria.
Christoph SinzViDIR Group, Department of Dermatology, Medical University of Vienna, Vienna, Austria.
Martina MittlböckCenter for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Vienna, Austria.
Harald KittlerViDIR Group, Department of Dermatology, Medical University of Vienna, Vienna, Austria.
Philipp TschandlViDIR Group, Department of Dermatology, Medical University of Vienna, Vienna, Austria.
Medical University of Vienna · AT

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

importanceThe recent advances in the field of machine learning have raised expectations that computer-aided diagnosis will become the standard for the diagnosis of melanoma.

objectiveTo critically review the current literature and compare the diagnostic accuracy of computer-aided diagnosis with that of human experts. DATA SOURCES: The MEDLINE, arXiv, and PubMed Central databases were searched to identify eligible studies published between January 1, 2002, and December 31, 2018. STUDY SELECTION: Studies that reported on the accuracy of automated systems for melanoma were selected. Search terms included melanoma, diagnosis, detection, computer aided, and artificial intelligence. DATA EXTRACTION AND SYNTHESIS: Evaluation of the risk of bias was performed using the QUADAS-2 tool, and quality assessment was based on predefined criteria. Data were analyzed from February 1 to March 10, 2019. MAIN OUTCOMES AND MEASURES: Summary estimates of sensitivity and specificity and summary receiver operating characteristic curves were the primary outcomes.

resultsThe literature search yielded 1694 potentially eligible studies, of which 132 were included and 70 offered sufficient information for a quantitative analysis. Most studies came from the field of computer science. Prospective clinical studies were rare. Combining the results for automated systems gave a melanoma sensitivity of 0.74 (95% CI, 0.66-0.80) and a specificity of 0.84 (95% CI, 0.79-0.88). Sensitivity was lower in studies that used independent test sets than in those that did not (0.51; 95% CI, 0.34-0.69 vs 0.82; 95% CI, 0.77-0.86; P < .001); however, the specificity was similar (0.83; 95% CI, 0.71-0.91 vs 0.85; 95% CI, 0.80-0.88; P = .67). In comparison with dermatologists' diagnosis, computer-aided diagnosis showed similar sensitivities and a 10 percentage points lower specificity, but the difference was not statistically significant. Studies were heterogeneous and substantial risk of bias was found in all but 4 of the 70 studies included in the quantitative analysis. CONCLUSIONS AND RELEVANCE: Although the accuracy of computer-aided diagnosis for melanoma detection is comparable to that of experts, the real-world applicability of these systems is unknown and potentially limited owing to overfitting and the risk of bias of the studies at hand.

Identifiers

PMID31215969
PMCPMC6584889
OpenAlexW2952313545

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.