Evidence map›Paper›PMID 35716038›Full record

ArticleStatistics in medicine2022

Deep reinforcement learning for personalized treatment recommendation.

Mingyang Liu, Xiaotong Shen, Wei Pan

Abstract read
In one paragraph

Article in Statistics in medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Review
  5. Review
  6. Review
  7. Review
  8. Review
  9. Review
  10. Article
  11. Review
  12. Review
  13. Article
  14. Article
  15. Review
  16. Article
  17. Review
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Mingyang LiuSchool of Statistics, University of Minnesota, Minneapolis, Minnesota, USA.
Xiaotong ShenSchool of Statistics, University of Minnesota, Minneapolis, Minnesota, USA.ORCID 0000-0003-1300-1451
Wei PanDivision of Biostatistics, University of Minnesota, Minneapolis, Minnesota, USA.ORCID 0000-0002-1159-0582

Funding

Causal and integrative deep learning for Alzheimer's disease geneticsU01AG073079 · NIA · UNIVERSITY OF MINNESOTA · PI PAN, WEI · 2021 to 2025
$3.5M
Deep Learning with Neuroimaging Genetic Data for Alzheimer's DiseaseR01AG069895 · NIA · UNIVERSITY OF MINNESOTA · PI PAN, WEI, SHEN, XIAOTONG TOM · 2020 to 2024
$3.4M
Estimation and inference in directed acyclic graphical models for biological networksR01AG074858 · NIA · UNIVERSITY OF MINNESOTA · PI Wei Pan, XIAOTONG Tom SHEN · 2022 to 2026
$3.2M
Discovering causal genes, brain regions and other risk factors for Alzheimer's DiseaseR01AG065636 · NIA · UNIVERSITY OF MINNESOTA · PI PAN, WEI · 2020 to 2024
$3.1M
Estimation and Inference of Gene Regulatory NetworksR01GM126002 · NIGMS · UNIVERSITY OF MINNESOTA · PI PAN, WEI, SHEN, XIAOTONG TOM · 2017 to 2020
$1.4M
NIA NIH HHS R01 AG065636NIA NIH HHS R01 AG069895NIA NIH HHS R01 AG074858NIA NIH HHS U01 AG073079NIGMS NIH HHS R01 GM126002NIH HHS R01AG065636NIH HHS R01AG069895NIH HHS R01AG074858NIH HHS R01GM126002NIH HHS U01AG073079
6 · The paper itself

Abstract

In precision medicine, the ultimate goal is to recommend the most effective treatment to an individual patient based on patient-specific molecular and clinical profiles, possibly high-dimensional. To advance cancer treatment, large-scale screenings of cancer cell lines against chemical compounds have been performed to help better understand the relationship between genomic features and drug response; existing machine learning approaches use exclusively supervised learning, including penalized regression and recommender systems. However, it would be more efficient to apply reinforcement learning to sequentially learn as data accrue, including selecting the most promising therapy for a patient given individual molecular and clinical features and then collecting and learning from the corresponding data. In this article, we propose a novel personalized ranking system called Proximal Policy Optimization Ranking (PPORank), which ranks the drugs based on their predicted effects per cell line (or patient) in the framework of deep reinforcement learning (DRL). Modeled as a Markov decision process, the proposed method learns to recommend the most suitable drugs sequentially and continuously over time. As a proof-of-concept, we conduct experiments on two large-scale cancer cell line data sets in addition to simulated data. The results demonstrate that the proposed DRL-based PPORank outperforms the state-of-the-art competitors based on supervised learning. Taken together, we conclude that novel methods in the framework of DRL have great potential for precision medicine and should be further studied.

Indexed as

NeoplasmsPrecision MedicineHumansMachine LearningMarkov Chainsactor-critic methodsdeep learningprecision medicineProximal Policy Optimizationrecommender systems

Identifiers

PMID35716038
PMCPMC9427729

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.