Evidence map›Paper›PMID 23741197›Full record

ArticleJournal of machine learning research : JMLR2012

Linear Fitted-Q Iteration with Multiple Reward Functions.

Daniel J Lizotte, Michael Bowling, Susan A Murphy

Abstract read
In one paragraph

Article in Journal of machine learning research : JMLR, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
3.8field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 71 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. When the Ends do not Justify the Means: Learning Who is Predicted to Have Harmful Indirect Effects.Journal of the Royal Statistical Society. Series A, (Statistics in Society) · 2022
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Estimation and Optimization of Composite Outcomes.Journal of machine learning research : JMLR · 2021
    Article
  11. Precision Medicine.Annual review of statistics and its application · 2019
    Article
  12. Article
  13. Article
  14. Multi-Objective Markov Decision Processes for Data-Driven Decision Support.Journal of machine learning research : JMLR · 2016
    Article
  15. Article
  16. Estimation of optimal dynamic treatment regimes.Clinical trials (London, England) · 2014
    Article
  17. Article
  18. Dynamic Treatment Regimes.Annual review of statistics and its application · 2014
    Article
  19. Adaptive Interventions in Child and Adolescent Mental Health.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 1 institution in 1 country.

Daniel J LizotteDavid R. Cheriton School of Computer Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada, DLIZOTTE@UWATERLOO.CA.
Michael Bowling
Susan A Murphy
University of Waterloo · CA

Funding

THE REFINEMENT &APPLICATION OF MEDICAL DECISION MAKING IN PREVENTION SCIENCESP50DA010075 · NIDA · PENNSYLVANIA STATE UNIVERSITY-UNIV PARK · PI COLLINS, LINDA M · 1996 to 2014
$24.5M
PUBLIC EDUCATION CAMPAIGN ON DEPRESSION DARTN01MH090001 · NIMH · UNIVERSITY OF NORTH CAROLINA CHAPEL HILL · 1989 to 2003
$10.4M
Learning Adaptive Treatment Strategies in Mental HealthR01MH080015 · NIMH · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI MURPHY, SUSAN A · 2007 to 2011
$2.2M
NIDA NIH HHS P50 DA010075NIMH NIH HHS N01 MH090001NIMH NIH HHS R01 MH080015
6 · The paper itself

Abstract

We present a general and detailed development of an algorithm for finite-horizon fitted-Q iteration with an arbitrary number of reward signals and linear value function approximation using an arbitrary number of state features. This includes a detailed treatment of the 3-reward function case using triangulation primitives from computational geometry and a method for identifying globally dominated actions. We also present an example of how our methods can be used to construct a real-world decision aid by considering symptom reduction, weight gain, and quality of life in sequential treatments for schizophrenia. Finally, we discuss future directions in which to take this work that will further enable our methods to make a positive impact on the field of evidence-based clinical decision support.

Indexed as

decision makingdynamic programminglinear regressionpreference elicitationreinforcement learning

Identifiers

PMID23741197
PMCPMC3670261
OpenAlexW2167062306

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.