ArticleRadiology2020
Artificial Intelligence Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Origin at Chest CT.
Erratum issued Registry-linked trialOpen access · greenAbstract read
In one paragraph
Article in Radiology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. It is linked to trial NCT04834934 (Artificial Intelligence - SARS-CoV-2 Risk Evaluation), which is not on this map. Cited by 221 papers, 8 of them syntheses that pooled it.
0numbers the graph read from it
0cells of the map it votes in
221citing papers in PubMed, 8 pooled it
39.5field-weighted citation impact, top 1% of its field
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Artificial Intelligence - SARS-CoV-2 Risk Evaluation
Who cites it
221 citing papers in PubMed, 8 syntheses or guidelines pooled it, 399 citations in OpenAlex.
- Thoracic imaging tests for the diagnosis of COVID-19.The Cochrane database of systematic reviews · 2022Pooled it
- Supervised and weakly supervised deep learning models for COVID-19 CT diagnosis: A systematic review.Computer methods and programs in biomedicine · 2022Pooled it
- Automated COVID-19 diagnosis and prognosis with medical imaging and who is publishing: a systematic review.Physical and engineering sciences in medicine · 2022Pooled it
- Artificial intelligence for imaging-based COVID-19 detection: Systematic review comparing added value of AI versus human readers.European journal of radiology · 2021Pooled it
- Diagnostic Test Accuracy of Deep Learning Detection of COVID-19: A Systematic Review and Meta-Analysis.Academic radiology · 2021Pooled it
- Digital imaging, technologies and artificial intelligence applications during COVID-19 pandemic.Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society · 2021Pooled it
- Thoracic imaging tests for the diagnosis of COVID-19.The Cochrane database of systematic reviews · 2021Pooled it
- Artificial Intelligence for COVID-19: A Systematic Review.Frontiers in medicine · 2021Pooled it
- Early Immunological Biomarkers for Personalized Treatment Selection in Severe COVID-19: Post Hoc Machine Learning Analysis of a Randomized Clinical Trial.JMIR medical informatics · 2026Article
- Artificial Intelligence in Oncology: A Comprehensive Cross-Cancer Translational Readiness Analysis Across 18 Malignancies.Cancers · 2026Review
- Performance of AI Approaches for COVID-19 Diagnosis Using Chest CT Scans: The Impact of Architecture and Dataset.RoFo : Fortschritte auf dem Gebiete der Rontgenstrahlen und der Nuklearmedizin · 2026Article
- From de-skilling to up-skilling: How artificial intelligence will augment the modern physician.Journal of experimental orthopaedics · 2026Review
- Diagnostic Performance of Artificial Intelligence in Detecting COVID-19 Pneumonia on Chest Imaging.Cureus · 2026Review
- Utility of the virtual imaging trials methodology for objective characterization of AI systems and training data.Journal of medical imaging (Bellingham, Wash.) · 2026Article
- Diagnostic accuracy of AI in chest radiography for pneumonia and lung cancer: A meta-analysis.European journal of radiology open · 2025Article
- Impact of artificial intelligence assistance on bone scintigraphy diagnosis.Physical and engineering sciences in medicine · 2025Article
- Revolutionizing emergency care: an overview of the transformative role of artificial intelligence in diagnosis, triage, and patient management.International journal of emergency medicine · 2025Review
- Multimodal text guided network for chest CT pneumonia classification.Scientific reports · 2025Article
- Synergistic Imaging: Combined Lung Ultrasound and Low-Dose Chest CT for Quantitative Assessment of COVID-19 Severity-A Prospective Observational Study.Diagnostics (Basel, Switzerland) · 2025Article
- Deep Learning Network Selection and Optimized Information Fusion for Enhanced COVID-19 Detection: A Literature Review.Diagnostics (Basel, Switzerland) · 2025Review
161 more citing papers are in PubMed but not listed here.
Corrections and comments
- Commented on by
- Erratum issued
Authors and funding
22 authors at 2 institutions in 2 countries.
Harrison X Bai *From the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0002-7460-8866
Robin Wang *From the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0001-7369-0602
Zeng XiongFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0003-4879-4279
Ben HsiehFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0001-5209-801X
Ken ChangFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0001-6956-5059
Kasey HalseyFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0002-6746-8615
Thi My Linh TranFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0002-8126-1258
Ji Whae ChoiFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0003-1061-3102
Dong-Cui WangFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0002-4435-2214
Lin-Bo ShiFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Ji MeiFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Xiao-Long JiangFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Ian PanFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0002-0650-6614
Qiu-Hua ZengFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Ping-Feng HuFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Yi-Hui LiFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Fei-Xian FuFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Raymond Y HuangFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0001-7661-797X
Ronnie SebroFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Qi-Zhi YuFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).
Michael K AtalayFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0003-3549-2634
Wei-Hua LiaoFrom the Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, China (H.X.B., Z.X., D.C.W., W.H.L.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI (H.X.B., B.H., K.H., I.P., M.K.A.); Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (R.W.); Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology. Massachusetts General Hospital, Boston, Mass (K.C.); Warren Alpert Medical School at Brown University, Providence, RI (H.X.B., K.H., T.M.L.T., J.W.C., I.P.); Department of Radiology, Yongzhou Central Hospital, Yongzhou, China (L.B.S.); Department of Radiology, Changde Second People's Hospital, Changde, China (J.M.); Department of Radiology, Affiliated Nan Hua Hospital, University of South China, Hengyang, China (X.L.J.); Department of Radiology, Loudi Central Hospital, Loudi, China (Q.H.Z.); Department of Radiology, Chenzhou Second People's Hospital, Chenzhou, China (P.F.H.); Department of Radiology, Zhuzhou Central Hospital, Zhuzhou, China (Y.H.L.); Department of Radiology, Yiyang City Center Hospital, Yiyang, China (F.X.F.); Department of Radiology, Brigham and Women's Hospital, Boston, Mass (R.Y.H.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (R.S.); and Department of Radiology, The First Hospital of Changsha, Changsha, China (Q.Z.Y.).ORCID 0000-0002-1926-3527
Central South University · CNBrigham and Women's Hospital · US
Funding
No grant is acknowledged in the PubMed record.
Abstract
Background Coronavirus disease 2019 (COVID-19) and pneumonia of other diseases share similar CT characteristics, which contributes to the challenges in differentiating them with high accuracy. Purpose To establish and evaluate an artificial intelligence (AI) system for differentiating COVID-19 and other pneumonia at chest CT and assessing radiologist performance without and with AI assistance. Materials and Methods A total of 521 patients with positive reverse transcription polymerase chain reaction results for COVID-19 and abnormal chest CT findings were retrospectively identified from 10 hospitals from January 2020 to April 2020. A total of 665 patients with non-COVID-19 pneumonia and definite evidence of pneumonia at chest CT were retrospectively selected from three hospitals between 2017 and 2019. To classify COVID-19 versus other pneumonia for each patient, abnormal CT slices were input into the EfficientNet B4 deep neural network architecture after lung segmentation, followed by a two-layer fully connected neural network to pool slices together. The final cohort of 1186 patients (132 583 CT slices) was divided into training, validation, and test sets in a 7:2:1 and equal ratio. Independent testing was performed by evaluating model performance in separate hospitals. Studies were blindly reviewed by six radiologists without and then with AI assistance. Results The final model achieved a test accuracy of 96% (95% confidence interval [CI]: 90%, 98%), a sensitivity of 95% (95% CI: 83%, 100%), and a specificity of 96% (95% CI: 88%, 99%) with area under the receiver operating characteristic curve of 0.95 and area under the precision-recall curve of 0.90. On independent testing, this model achieved an accuracy of 87% (95% CI: 82%, 90%), a sensitivity of 89% (95% CI: 81%, 94%), and a specificity of 86% (95% CI: 80%, 90%) with area under the receiver operating characteristic curve of 0.90 and area under the precision-recall curve of 0.87. Assisted by the probabilities of the model, the radiologists achieved a higher average test accuracy (90% vs 85%, Δ = 5,
Indexed as
Artificial IntelligenceRadiologistsAdolescentAdultAgedAged, 80 and overBetacoronavirusChildChild, PreschoolChinaCoronavirus InfectionsCOVID-19Diagnosis, DifferentialFemaleHumansInfant
Identifiers
What OpenQuestion holds
Textmetadata
Read underepoch 390
Registered trials
NCT04834934ClinicalTrials.gov
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.