Evidence map›Paper›PMID 34526699›Full record

ArticleNature medicine2021

Federated learning for predicting clinical outcomes in patients with COVID-19.

Ittai Dayan, Holger R Roth, Aoxiao Zhong, Ahmed Harouni, Amilcare Gentili, Anas Z Abidin, Andrew Liu, Anthony Beardsworth Costa, Bradford J Wood, Chien-Sung Tsai and 89 more

Abstract read
In one paragraph

Article in Nature medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 241 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
241citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

241 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

181 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

99 authors.

Ittai Dayan *MGH Radiology and Harvard Medical School, Boston, MA, USA.
Holger R Roth *NVIDIA, Santa Clara, CA, USA.ORCID http://orcid.org/0000-0002-3662-8743
Aoxiao Zhong *Center for Advanced Medical Computing and Analysis, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.ORCID http://orcid.org/0000-0002-7584-5476
Ahmed HarouniNVIDIA, Santa Clara, CA, USA.
Amilcare GentiliSan Diego VA Health Care System, San Diego, CA, USA.
Anas Z AbidinNVIDIA, Santa Clara, CA, USA.
Andrew LiuNVIDIA, Santa Clara, CA, USA.
Anthony Beardsworth CostaDepartment of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA.ORCID http://orcid.org/0000-0002-2202-6450
Bradford J WoodRadiology & Imaging Sciences/Clinical Center, National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0002-4297-0051
Chien-Sung TsaiDivision of Cardiovascular Surgery, Department of Surgery, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan.
Chih-Hung WangDepartment of Otolaryngology-Head and Neck Surgery, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan.ORCID http://orcid.org/0000-0001-5058-4356
Chun-Nan HsuCenter for Research in Biological Systems, University of California, San Diego, CA, USA.ORCID http://orcid.org/0000-0002-5240-4707
C K LeeNVIDIA, Santa Clara, CA, USA.
Peiying RuanNVIDIA, Santa Clara, CA, USA.
Daguang XuNVIDIA, Santa Clara, CA, USA.
Dufan WuCenter for Advanced Medical Computing and Analysis, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Eddie HuangNVIDIA, Santa Clara, CA, USA.
Felipe Campos KitamuraDasaInova, Diagnósticos da América SA, Barueri, Brazil.ORCID http://orcid.org/0000-0002-9992-5630
Griffin LaceyNVIDIA, Santa Clara, CA, USA.
Gustavo César de Antônio CorradiDasaInova, Diagnósticos da América SA, Barueri, Brazil.
Gustavo NinoDivision of Pediatric Pulmonary and Sleep Medicine, Children's National Hospital, Washington, DC, USA.
Hao-Hsin ShinMemorial Sloan Kettering Cancer Center, New York, NY, USA.ORCID http://orcid.org/0000-0003-2127-8645
Hirofumi ObinataSelf-Defense Forces Central Hospital, Tokyo, Japan.
Hui RenCenter for Advanced Medical Computing and Analysis, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Jason C CraneCenter for Intelligent Imaging, Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA.
Jesse TetreaultNVIDIA, Santa Clara, CA, USA.
Jiahui GuanNVIDIA, Santa Clara, CA, USA.
John W GarrettDepartments of Radiology and Medical Physics, The University of Wisconsin-Madison School of Medicine and Public Health, Madison, WI, USA.ORCID http://orcid.org/0000-0002-8152-736X
Joshua D KaggieDepartment of Radiology, NIHR Cambridge Biomedical Resource Centre, University of Cambridge, Cambridge, UK.
Jung Gil ParkDepartment of Internal Medicine, Yeungnam University College of Medicine, Daegu, South Korea.ORCID http://orcid.org/0000-0001-5472-4731
Keith DreyerMGH Radiology and Harvard Medical School, Boston, MA, USA.
Krishna JuluruMemorial Sloan Kettering Cancer Center, New York, NY, USA.
Kristopher KerstenNVIDIA, Santa Clara, CA, USA.
Marcio Aloisio Bezerra Cavalcanti RockenbachCenter for Clinical Data Science, Massachusetts General Brigham, Boston, MA, USA.ORCID http://orcid.org/0000-0003-1783-0441
Marius George LinguraruSheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, USA.
Masoom A HaiderJoint Dept. of Medical Imaging, Sinai Health System, University of Toronto, Toronto, Ontario, Canada.
Meena AbdelMaseehLunenfeld-Tanenbaum Research Institute, Toronto, Ontario, Canada.
Nicola RiekeNVIDIA, Santa Clara, CA, USA.ORCID http://orcid.org/0000-0003-0241-9334
Pablo F DamascenoCenter for Intelligent Imaging, Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA.ORCID http://orcid.org/0000-0001-5615-121X
Pedro Mario Cruz E SilvaNVIDIA, Santa Clara, CA, USA.
Pochuan WangMeDA Lab Institute of Applied Mathematical Sciences, National Taiwan University, Taipei, Taiwan.ORCID http://orcid.org/0000-0002-3856-048X
Sheng XuRadiology & Imaging Sciences/Clinical Center, National Institutes of Health, Bethesda, MD, USA.
Shuichi KawanoSelf-Defense Forces Central Hospital, Tokyo, Japan.
Sira SriswasdiResearch Affairs, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.ORCID http://orcid.org/0000-0002-4117-3632
Soo Young ParkDepartment of Internal Medicine, School of Medicine, Kyungpook National University, Daegu, South Korea.
Thomas M GristDepartments of Radiology, Medical Physics, and Biomedical Engineering, The University of Wisconsin-Madison School of Medicine and Public Health, Madison, WI, USA.
Varun BuchCenter for Clinical Data Science, Massachusetts General Brigham, Boston, MA, USA.
Watsamon JantarabenjakulDepartment of Pediatrics, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Weichung WangMeDA Lab Institute of Applied Mathematical Sciences, National Taiwan University, Taipei, Taiwan.
Won Young TakDepartment of Internal Medicine, School of Medicine, Kyungpook National University, Daegu, South Korea.
Xiang LiCenter for Advanced Medical Computing and Analysis, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.ORCID http://orcid.org/0000-0002-9851-6376
Xihong LinHarvard T.H. Chan School of Public Health, Harvard University, Boston, MA, USA.ORCID http://orcid.org/0000-0001-7067-7752
Young Joon KwonDepartment of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
Abood QurainiNVIDIA, Santa Clara, CA, USA.
Andrew FengNVIDIA, Santa Clara, CA, USA.
Andrew N PriestDepartment of Radiology, NIHR Cambridge Biomedical Resource Centre, Cambridge University Hospital, Cambridge, UK.ORCID http://orcid.org/0000-0002-9771-4290
Baris TurkbeyNational Cancer Institute, National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0003-0853-6494
Benjamin GlicksbergHasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai and Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA.ORCID http://orcid.org/0000-0003-4515-8090
Bernardo BizzoCenter for Clinical Data Science, Massachusetts General Brigham, Boston, MA, USA.ORCID http://orcid.org/0000-0002-9686-6751
Byung Seok KimDepartment of Internal Medicine, Catholic University of Daegu School of Medicine, Daegu, South Korea.
Carlos Tor-DíezSheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, USA.
Chia-Cheng LeePlanning and Management Office, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan.
Chia-Jung HsuPlanning and Management Office, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan.
Chin LinSchool of Medicine, National Defense Medical Center, Taipei, Taiwan.
Chiu-Ling LaiMedical Review and Pharmaceutical Benefits Division, National Health Insurance Administration, Taipei, Taiwan.
Christopher P HessCenter for Intelligent Imaging, Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA.
Colin CompasNVIDIA, Santa Clara, CA, USA.
Deepeksha BhatiaNVIDIA, Santa Clara, CA, USA.
Eric K OermannDepartment of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA.
Evan LeibovitzCenter for Clinical Data Science, Massachusetts General Brigham, Boston, MA, USA.
Hisashi SasakiSelf-Defense Forces Central Hospital, Tokyo, Japan.
Hitoshi MoriSelf-Defense Forces Central Hospital, Tokyo, Japan.
Isaac YangNVIDIA, Santa Clara, CA, USA.
Jae Ho SohnCenter for Intelligent Imaging, Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA.
Krishna Nand Keshava MurthyMemorial Sloan Kettering Cancer Center, New York, NY, USA.ORCID http://orcid.org/0000-0003-2408-7414
Li-Chen FuMOST/NTU All Vista Healthcare Center, Center for Artificial Intelligence and Advanced Robotics, National Taiwan University, Taipei, Taiwan.
Matheus Ribeiro Furtado de MendonçaDasaInova, Diagnósticos da América SA, Barueri, Brazil.ORCID http://orcid.org/0000-0001-5541-7207
Mike FralickDivision of General Internal Medicine and Geriatrics (Fralick), Sinai Health System, Toronto, Ontario, Canada.
Min Kyu KangDepartment of Internal Medicine, Yeungnam University College of Medicine, Daegu, South Korea.ORCID http://orcid.org/0000-0002-1435-3312
Mohammad AdilNVIDIA, Santa Clara, CA, USA.
Natalie GangaiMemorial Sloan Kettering Cancer Center, New York, NY, USA.
Peerapon VateekulDepartment of Computer Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok, Thailand.ORCID http://orcid.org/0000-0001-9718-3592
Pierre ElnajjarMemorial Sloan Kettering Cancer Center, New York, NY, USA.
Sarah HickmanDepartment of Radiology, NIHR Cambridge Biomedical Resource Centre, University of Cambridge, Cambridge, UK.
Sharmila MajumdarCenter for Intelligent Imaging, Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA.
Shelley L McLeodSchwartz/Reisman Emergency Medicine Institute, Sinai Health, Toronto, Ontario, Canada.
Sheridan ReedRadiology & Imaging Sciences/Clinical Center, National Institutes of Health, Bethesda, MD, USA.
Stefan GräfDepartment of Medicine and NIHR BioResource for Translational Research, NIHR Cambridge Biomedical Research Centre, University of Cambridge, Cambridge, UK.ORCID http://orcid.org/0000-0002-1315-8873
Stephanie HarmonNational Cancer Institute, National Institutes of Health, Bethesda, MD, USA.ORCID http://orcid.org/0000-0002-2507-2399
Tatsuya KodamaSelf-Defense Forces Central Hospital, Tokyo, Japan.
Thanyawee PuthanakitDepartment of Pediatrics, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Tony MazzulliDepartment of Microbiology, Sinai Health/University Health Network, Toronto, Ontario, Canada.
Vitor Lima de LavorDasaInova, Diagnósticos da América SA, Barueri, Brazil.
Yothin RakvongthaiChulalongkorn University Biomedical Imaging Group and Division of Nuclear Medicine, Department of Radiology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Yu Rim LeeDepartment of Internal Medicine, School of Medicine, Kyungpook National University, Daegu, South Korea.
Yuhong WenNVIDIA, Santa Clara, CA, USA.
Fiona J Gilbert *Department of Radiology, NIHR Cambridge Biomedical Resource Centre, University of Cambridge, Cambridge, UK.ORCID http://orcid.org/0000-0002-0124-9962
Mona G Flores *NVIDIA, Santa Clara, CA, USA. mflores@nvidia.com.ORCID http://orcid.org/0000-0002-7362-3044
Quanzheng Li *Center for Advanced Medical Computing and Analysis, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
Center for Interventional OncologyZIDBC011242 · NCI · DIVISION OF BASIC SCIENCES - NCI · PI WOOD, BRADFORD J · 2009 to 2025
$18.7M
THE HUMAN INFANT AIRWAY EPITHELIUM AND RECURRENT WHEEZING AFTER RV AND RSV INFECTIONR01HL141237 · NHLBI · CHILDREN'S RESEARCH INSTITUTE · PI NINO, GUSTAVO · 2019 to 2022
$2.8M
Imaging biomarkers of severe respiratory infections in premature infants Phase IIR42HL145669 · NHLBI · KITWARE, INC. · PI ENQUOBAHRIE, ANDINET ASMAMAW, LINGURARU, MARIUS GEORGE · 2021 to 2022
$1.7M
Can machines be trusted? Robustification of deep learning for medical imagingR01LM013151 · NLM · UNIVERSITY OF WISCONSIN-MADISON · PI GARRETT, JOHN WILLIAM, MCMILLAN, ALAN BLAIR · 2020 to 2023
$1.3M
Interventional OncologyZIACL040015 · CLC · CLINICAL CENTER · PI WOOD, BRADFORD · 2009 to 2025
$0k
Cancer Research UK 26884Intramural NIH HHS ZIA CL040015Intramural NIH HHS ZID BC011242NCI NIH HHS P30 CA008748NHLBI NIH HHS R01 HL141237NHLBI NIH HHS R42 HL145669NLM NIH HHS R01 LM013151
6 · The paper itself

Abstract

Federated learning (FL) is a method used for training artificial intelligence models with data from multiple sources while maintaining data anonymity, thus removing many barriers to data sharing. Here we used data from 20 institutes across the globe to train a FL model, called EXAM (electronic medical record (EMR) chest X-ray AI model), that predicts the future oxygen requirements of symptomatic patients with COVID-19 using inputs of vital signs, laboratory data and chest X-rays. EXAM achieved an average area under the curve (AUC) >0.92 for predicting outcomes at 24 and 72 h from the time of initial presentation to the emergency room, and it provided 16% improvement in average AUC measured across all participating sites and an average increase in generalizability of 38% when compared with models trained at a single site using that site's data. For prediction of mechanical ventilation treatment or death at 24 h at the largest independent test site, EXAM achieved a sensitivity of 0.950 and specificity of 0.882. In this study, FL facilitated rapid data science collaboration without data exchange and generated a model that generalized across heterogeneous, unharmonized datasets for prediction of clinical outcomes in patients with COVID-19, setting the stage for the broader use of FL in healthcare.

Indexed as

Machine LearningOutcome Assessment, Health CareCOVID-19Electronic Health RecordsHumansPrognosisSARS-CoV-2

Identifiers

PMID34526699
PMCPMC9157510

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.