Evidence map›Paper›PMID 34193140›Full record

Trial reportBMC medical informatics and decision making2021

Electronic patient-reported outcomes and machine learning in predicting immune-related adverse events of immune checkpoint inhibitor therapies.

Sanna Iivanainen, Jussi Ekstrom, Henri Virtanen, Vesa V Kataja, Jussi P Koivunen

Open access · goldAbstract readClinical Trial
In one paragraph

Trial report in BMC medical informatics and decision making, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed, 1 pooled it
2.1field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed, 1 synthesis or guideline pooled it, 40 citations in OpenAlex.

  1. Exploring the role of health-related quality of life measures in predictive modelling for oncology: a systematic review.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Pooled it
  2. Review
  3. Review
  4. Review
  5. Beyond tumor biology: nursing interventions for psychological and immune health in cancer patients.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2026
    Review
  6. Article
  7. Article
  8. Review
  9. Article
  10. Review
  11. Review
  12. Article
  13. Review
  14. Article
  15. Improving assessment of financial toxicity of cancer immunotherapy.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2025
    Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Sanna IivanainenDepartment of Oncology and Radiotherapy, Oulu University Hospital and MRC Oulu, OYS, P.B. 22, 90029, Oulu, Finland. sanna.iivanainen@ppshp.fi.
Jussi EkstromKaiku Health Oy, Helsinki, Finland.
Henri VirtanenKaiku Health Oy, Helsinki, Finland.
Vesa V KatajaKaiku Health Oy, Helsinki, Finland.
Jussi P KoivunenDepartment of Oncology and Radiotherapy, Oulu University Hospital and MRC Oulu, OYS, P.B. 22, 90029, Oulu, Finland.
Oulu University Hospital · FI

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundImmune-checkpoint inhibitors (ICIs) have introduced novel immune-related adverse events (irAEs), arising from various organ systems without strong timely dependency on therapy dosing. Early detection of irAEs could result in improved toxicity profile and quality of life. Symptom data collected by electronic (e) patient-reported outcomes (PRO) could be used as an input for machine learning (ML) based prediction models for the early detection of irAEs.

methodsThe utilized dataset consisted of two data sources. The first dataset consisted of 820 completed symptom questionnaires from 34 ICI treated advanced cancer patients, including 18 monitored symptoms collected using the Kaiku Health digital platform. The second dataset included prospectively collected irAE data, Common Terminology Criteria for Adverse Events (CTCAE) class, and the severity of 26 irAEs. The ML models were built using extreme gradient boosting algorithms. The first model was trained to detect the presence and the second the onset of irAEs.

resultsThe model trained to predict the presence of irAEs had an excellent performance based on four metrics: accuracy score 0.97, Area Under the Curve (AUC) value 0.99, F1-score 0.94 and Matthew's correlation coefficient (MCC) 0.92. The prediction of the irAE onset was more difficult with accuracy score 0.96, AUC value 0.93, F1-score 0.66 and MCC 0.64 but the model performance was still at a good level.

conclusionThe current study suggests that ML based prediction models, using ePRO data as an input, can predict the presence and onset of irAEs with a high accuracy, indicating that ePRO follow-up with ML algorithms could facilitate the detection of irAEs in ICI-treated cancer patients. The results should be validated with a larger dataset. Trial registration Clinical Trials Register (NCT3928938), registration date the 26th of April, 2019.

Indexed as

Immune Checkpoint InhibitorsQuality of LifeElectronicsHumansMachine LearningPatient Reported Outcome MeasuresRetrospective StudiesImmune Checkpoint InhibitorsePROImmune checkpoint inhibitorirAEMachine learningPrediction modelPrognosis

Identifiers

PMID34193140
PMCPMC8243435
OpenAlexW3119641577

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.