Evidence map›Paper›PMID 32810047›Full record

ArticleChinese medical journal2020

Diagnostic capacity of skin tumor artificial intelligence-assisted decision-making software in real-world clinical settings.

Cheng-Xu Li, Wen-Min Fei, Chang-Bing Shen, Zi-Yi Wang, Yan Jing, Ru-Song Meng, Yong Cui

Open access · goldAbstract read
In one paragraph

Article in Chinese medical journal, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 2 pooled it
0.9field-weighted citation impact, top 23% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 2 syntheses or guidelines pooled it, 21 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Review
  5. Review
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 4 institutions in 2 countries.

Cheng-Xu LiDepartment of Dermatology, China-Japan Friendship Hospital, Beijing 100029, China.
Wen-Min FeiDepartment of Dermatology, China-Japan Friendship Hospital, Beijing 100029, China.
Chang-Bing ShenDepartment of Dermatology, China-Japan Friendship Hospital, Beijing 100029, China.
Zi-Yi WangDepartment of Dermatology, China-Japan Friendship Hospital, Beijing 100029, China.
Yan JingDepartment of Dermatology, The First Affiliated Hospital, Anhui Medical University, Hefei, Anhui 230032, China.
Ru-Song MengDepartment of Dermatology, Specialty Medical Center of the Air Force, Chinese People's Liberation Army, Beijing 100142, China.
Yong CuiDepartment of Dermatology, China-Japan Friendship Hospital, Beijing 100029, China.
Chinese Academy of Medical Sciences & Peking Union Medical College · CNChina-Japan Friendship Hospital · CNAir Force General Hospital PLA · CNFirst Affiliated Hospital of Anhui Medical University · CN

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundYouzhi artificial intelligence (AI) software is the AI-assisted decision-making system for diagnosing skin tumors. The high diagnostic accuracy of Youzhi AI software was previously validated in specific datasets. The objective of this study was to compare the performance of diagnostic capacity between Youzhi AI software and dermatologists in real-world clinical settings.

methodsA total of 106 patients who underwent skin tumor resection in the Dermatology Department of China-Japan Friendship Hospital from July 2017 to June 2019 and were confirmed as skin tumors by pathological biopsy were selected. Dermoscopy and clinical images of 106 patients were diagnosed by Youzhi AI software and dermatologists at different dermoscopy diagnostic levels. The primary outcome was to compare the diagnostic accuracy of the Youzhi AI software with that of dermatologists and that measured in the laboratory using specific data sets. The secondary results included the sensitivity, specificity, positive predictive value, negative predictive value, F-measure, and Matthews correlation coefficient of Youzhi AI software in the real-world.

resultsThe diagnostic accuracy of Youzhi AI software in real-world clinical settings was lower than that of the laboratory data (P < 0.001). The output result of Youzhi AI software has good stability after several tests. Youzhi AI software diagnosed benign and malignant diseases by recognizing dermoscopic images and diagnosed disease types with higher diagnostic accuracy than by recognizing clinical images (P = 0.008, P = 0.016, respectively). Compared with dermatologists, Youzhi AI software was more accurate in the diagnosis of skin tumor types through the recognition of dermoscopic images (P = 0.01). By evaluating the diagnostic performance of dermatologists under different modes, the diagnostic accuracy of dermatologists in diagnosing disease types by matching dermoscopic and clinical images was significantly higher than that by identifying dermoscopic and clinical images in random sequence (P = 0.022). The diagnostic accuracy of dermatologists in the diagnosis of benign and malignant diseases by recognizing dermoscopic images was significantly higher than that by recognizing clinical images (P = 0.010).

conclusionThe diagnostic accuracy of Youzhi AI software for skin tumors in real-world clinical settings was not as high as that of using special data sets in the laboratory. However, there was no significant difference between the diagnostic capacity of Youzhi AI software and the average diagnostic capacity of dermatologists. It can provide assistant diagnostic decisions for dermatologists in the current state.

Indexed as

MelanomaSkin NeoplasmsArtificial IntelligenceChinaDermatologistsDermoscopyHumansJapanSensitivity and SpecificitySoftware

Identifiers

PMID32810047
PMCPMC7478744
OpenAlexW3074784024

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.