ReviewJMIR medical informatics2019
Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review.
Review in JMIR medical informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 145 papers, 14 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
145 citing papers in PubMed, 14 syntheses or guidelines pooled it, 350 citations in OpenAlex.
- Artificial intelligence demonstrates comparable diagnostic accuracy to radiologists for anterior cruciate ligament tears on MRI: A systematic review and meta-analysis.Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA · 2026Pooled it
- Artificial Intelligence in Diagnosing Depression Through Behavioural Cues: A Diagnostic Accuracy Systematic Review and Meta-Analysis.Journal of clinical nursing · 2026Pooled it
- AI chatbots versus human healthcare professionals: a systematic review and meta-analysis of empathy in patient care.British medical bulletin · 2025Pooled it
- Imaging based artificial intelligence for predicting lymph node metastasis in cervical cancer patients: a systematic review and meta-analysis.Frontiers in oncology · 2025Pooled it
- Artificial Intelligence (AI) and Healthcare Capabilities: A Systematic Review and Research Directions.F1000Research · 2025Pooled it
- The intelligent lift: Artificial Intelligence's growing role in plastic surgery - a comprehensive review.Frontiers in surgery · 2025Pooled it
- Ultrasound-based artificial intelligence for predicting cervical lymph node metastasis in papillary thyroid cancer: a systematic review and meta-analysis.Frontiers in endocrinology · 2025Pooled it
- Survival prediction landscape: an in-depth systematic literature review on activities, methods, tools, diseases, and databases.Frontiers in artificial intelligence · 2024Pooled it
- Advances in Leukemia detection and classification: A Systematic review of AI and image processing techniques.F1000Research · 2024Pooled it
- Interpretability of Clinical Decision Support Systems Based on Artificial Intelligence from Technological and Medical Perspective: A Systematic Review.Journal of healthcare engineering · 2023Pooled it
- Artificial intelligence for imaging-based COVID-19 detection: Systematic review comparing added value of AI versus human readers.European journal of radiology · 2021Pooled it
- Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review.Journal of medical Internet research · 2021Pooled it
- Artificial Intelligence for COVID-19: A Systematic Review.Frontiers in medicine · 2021Pooled it
- The Economic Impact of Artificial Intelligence in Health Care: Systematic Review.Journal of medical Internet research · 2020Pooled it
- Slice-Level Deep Learning Classification of Acute Cholecystitis on Contrast-Enhanced CT: A Single-Center Benchmark of Six CNN Architectures.Diagnostics (Basel, Switzerland) · 2026Article
- Assessment of drug harm by final-year medical students and ChatGPT - a comparative analysis.Substance abuse treatment, prevention, and policy · 2026Article
- Artificial intelligence in assisted localization of fetal ultrasound standard planes: a narrative review.Quantitative imaging in medicine and surgery · 2026Review
- Effects of Type and Timing of Clinician-Facing AI Support on Patient Trust in Medical Consultations: 2 Vignette Experiments.Journal of medical Internet research · 2026Article
- Article
- Artificial Intelligence and Healthcare Policy: A Bibliometric Analysis of Global Research Trends.Healthcare (Basel, Switzerland) · 2026Article
85 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
10 authors at 4 institutions in 3 countries.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundArtificial intelligence (AI) has been extensively used in a range of medical fields to promote therapeutic development. The development of diverse AI techniques has also contributed to early detections, disease diagnoses, and referral management. However, concerns about the value of advanced AI in disease diagnosis have been raised by health care professionals, medical service providers, and health policy decision makers.
objectiveThis review aimed to systematically examine the literature, in particular, focusing on the performance comparison between advanced AI and human clinicians to provide an up-to-date summary regarding the extent of the application of AI to disease diagnoses. By doing so, this review discussed the relationship between the current advanced AI development and clinicians with respect to disease diagnosis and thus therapeutic development in the long run.
methodsWe systematically searched articles published between January 2000 and March 2019 following the Preferred Reporting Items for Systematic reviews and Meta-Analysis in the following databases: Scopus, PubMed, CINAHL, Web of Science, and the Cochrane Library. According to the preset inclusion and exclusion criteria, only articles comparing the medical performance between advanced AI and human experts were considered.
resultsA total of 9 articles were identified. A convolutional neural network was the commonly applied advanced AI technology. Owing to the variation in medical fields, there is a distinction between individual studies in terms of classification, labeling, training process, dataset size, and algorithm validation of AI. Performance indices reported in articles included diagnostic accuracy, weighted errors, false-positive rate, sensitivity, specificity, and the area under the receiver operating characteristic curve. The results showed that the performance of AI was at par with that of clinicians and exceeded that of clinicians with less experience.
conclusionsCurrent AI development has a diagnostic performance that is comparable with medical experts, especially in image recognition-related fields. Further studies can be extended to other types of medical imaging such as magnetic resonance imaging and other medical practices unrelated to images. With the continued development of AI-assisted technologies, the clinical implications underpinned by clinicians' experience and guided by patient-centered health care principle should be constantly considered in future AI-related and other technology-based medical research.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.