Evidence map›Paper›PMID 34920724›Full record

ArticleBMC medical informatics and decision making2021

Reinforcement learning assisted oxygen therapy for COVID-19 patients under intensive care.

Hua Zheng, Jiahao Zhu, Wei Xie, Judy Zhong

Open access · goldAbstract read
In one paragraph

Article in BMC medical informatics and decision making, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
2.6field-weighted citation impact, top 9% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 26 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 1 country.

Hua ZhengDepartment of Mechanical and Industrial Engineering, Northeastern University, 360 Huntington Avenue, 334 SN, Boston, MA, 02115, USA.
Jiahao ZhuDepartment of Mechanical and Industrial Engineering, Northeastern University, 360 Huntington Avenue, 334 SN, Boston, MA, 02115, USA.
Wei XieDepartment of Mechanical and Industrial Engineering, Northeastern University, 360 Huntington Avenue, 334 SN, Boston, MA, 02115, USA. w.xie@northeastern.edu.
Judy ZhongDivision of Biostatistics, Department of Population Health, New York University School of Medicine, NYU Langone Health, 180 Madison Avenue, 4th Floor, Room 452, New York, NY, 10016, USA. judy.zhong@nyulangone.org.
Northeastern University · USNew York University · US

Funding

EHR-based vs population-based CVD risk predictions for older patients with diabetesR01AG065330 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI ZHONG, HUA JUDY · 2020 to 2024
$2.9M
CVD Risk and Outcome Heterogeneity in Older Adults with DiabetesR01AG054467 · NIA · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI ZHONG, HUA JUDY · 2017 to 2020
$1.7M
Personalized Risk Predictions with Deep Learning Methods in the Presence of Missing and Biased Electronic Health Record DataR01LM013344 · NLM · WEILL MEDICAL COLL OF CORNELL UNIV · PI SMYTH, PADHRAIC, ZHONG, HUA JUDY · 2021 to 2024
$1.3M
NIA NIH HHS R01 AG054467NIA NIH HHS R01 AG065330NLM NIH HHS R01 LM013344
6 · The paper itself

Abstract

backgroundPatients with severe Coronavirus disease 19 (COVID-19) typically require supplemental oxygen as an essential treatment. We developed a machine learning algorithm, based on deep Reinforcement Learning (RL), for continuous management of oxygen flow rate for critically ill patients under intensive care, which can identify the optimal personalized oxygen flow rate with strong potentials to reduce mortality rate relative to the current clinical practice.

methodsWe modeled the oxygen flow trajectory of COVID-19 patients and their health outcomes as a Markov decision process. Based on individual patient characteristics and health status, an optimal oxygen control policy is learned by using deep deterministic policy gradient (DDPG) and real-time recommends the oxygen flow rate to reduce the mortality rate. We assessed the performance of proposed methods through cross validation by using a retrospective cohort of 1372 critically ill patients with COVID-19 from New York University Langone Health ambulatory care with electronic health records from April 2020 to January 2021.

resultsThe mean mortality rate under the RL algorithm is lower than the standard of care by 2.57% (95% CI: 2.08-3.06) reduction (P < 0.001) from 7.94% under the standard of care to 5.37% under our proposed algorithm. The averaged recommended oxygen flow rate is 1.28 L/min (95% CI: 1.14-1.42) lower than the rate delivered to patients. Thus, the RL algorithm could potentially lead to better intensive care treatment that can reduce the mortality rate, while saving the oxygen scarce resources. It can reduce the oxygen shortage issue and improve public health during the COVID-19 pandemic.

conclusionsA personalized reinforcement learning oxygen flow control algorithm for COVID-19 patients under intensive care showed a substantial reduction in 7-day mortality rate as compared to the standard of care. In the overall cross validation cohort independent of the training data, mortality was lowest in patients for whom intensivists' actual flow rate matched the RL decisions.

Identifiers

PMID34920724
PMCPMC8678583
OpenAlexW3162012886

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.