Evidence map›Paper›PMID 31420959›Full record

ReviewJMIR medical informatics2019

Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review.

Jiayi Shen, Casper J P Zhang, Bangsheng Jiang, Jiebin Chen, Jian Song, Zherui Liu, Zonglin He, Sum Yi Wong, Po-Han Fang, Wai-Kit Ming

Open access · goldAbstract readReview
In one paragraph

Review in JMIR medical informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 145 papers, 14 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
145citing papers in PubMed, 14 pooled it
8.8field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

145 citing papers in PubMed, 14 syntheses or guidelines pooled it, 350 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article

85 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 4 institutions in 3 countries.

Jiayi Shen *Department of Obstetrics and Gynecology, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.ORCID http://orcid.org/0000-0002-7022-6940
Casper J P Zhang *School of Public Health, The University of Hong Kong, Hong Kong, China (Hong Kong).ORCID http://orcid.org/0000-0003-1047-0287
Bangsheng JiangInternational School, Jinan University, Guangzhou, China.ORCID http://orcid.org/0000-0002-1156-7462
Jiebin ChenCollege of Information Science and Technology, Jinan University, Guangzhou, China.ORCID http://orcid.org/0000-0002-1983-4094
Jian SongSchool of International Studies, Sun Yat-sen University, Guangzhou, China.ORCID http://orcid.org/0000-0002-6852-2986
Zherui LiuCollege of Information Science and Technology, Jinan University, Guangzhou, China.ORCID http://orcid.org/0000-0002-1991-3999
Zonglin HeInternational School, Jinan University, Guangzhou, China.ORCID http://orcid.org/0000-0001-7650-1459
Sum Yi WongInternational School, Jinan University, Guangzhou, China.ORCID http://orcid.org/0000-0001-5727-2849
Po-Han FangInternational School, Jinan University, Guangzhou, China.ORCID http://orcid.org/0000-0002-1246-086X
Wai-Kit MingDepartment of Obstetrics and Gynecology, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.ORCID http://orcid.org/0000-0002-8846-7515
Jinan University · CNSun Yat-sen University · CNBrigham and Women's Hospital · USUniversity of Hong Kong · HK

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundArtificial intelligence (AI) has been extensively used in a range of medical fields to promote therapeutic development. The development of diverse AI techniques has also contributed to early detections, disease diagnoses, and referral management. However, concerns about the value of advanced AI in disease diagnosis have been raised by health care professionals, medical service providers, and health policy decision makers.

objectiveThis review aimed to systematically examine the literature, in particular, focusing on the performance comparison between advanced AI and human clinicians to provide an up-to-date summary regarding the extent of the application of AI to disease diagnoses. By doing so, this review discussed the relationship between the current advanced AI development and clinicians with respect to disease diagnosis and thus therapeutic development in the long run.

methodsWe systematically searched articles published between January 2000 and March 2019 following the Preferred Reporting Items for Systematic reviews and Meta-Analysis in the following databases: Scopus, PubMed, CINAHL, Web of Science, and the Cochrane Library. According to the preset inclusion and exclusion criteria, only articles comparing the medical performance between advanced AI and human experts were considered.

resultsA total of 9 articles were identified. A convolutional neural network was the commonly applied advanced AI technology. Owing to the variation in medical fields, there is a distinction between individual studies in terms of classification, labeling, training process, dataset size, and algorithm validation of AI. Performance indices reported in articles included diagnostic accuracy, weighted errors, false-positive rate, sensitivity, specificity, and the area under the receiver operating characteristic curve. The results showed that the performance of AI was at par with that of clinicians and exceeded that of clinicians with less experience.

conclusionsCurrent AI development has a diagnostic performance that is comparable with medical experts, especially in image recognition-related fields. Further studies can be extended to other types of medical imaging such as magnetic resonance imaging and other medical practices unrelated to images. With the continued development of AI-assisted technologies, the clinical implications underpinned by clinicians' experience and guided by patient-centered health care principle should be constantly considered in future AI-related and other technology-based medical research.

Indexed as

artificial intelligencedeep learningdiagnosisdiagnostic imagingimage interpretation, computer-assistedpatient-centered care

Identifiers

PMID31420959
PMCPMC6716335
OpenAlexW2963852062

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.