Evidence map›Paper›PMID 33413321›Full record

ArticleBMC medical informatics and decision making2021

Applying probability calibration to ensemble methods to predict 2-year mortality in patients with DLBCL.

Shuanglong Fan, Zhiqiang Zhao, Hongmei Yu, Lei Wang, Chuchu Zheng, Xueqian Huang, Zhenhuan Yang, Meng Xing, Qing Lu, Yanhong Luo

Abstract read
In one paragraph

Article in BMC medical informatics and decision making, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Shuanglong FanDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China.
Zhiqiang ZhaoDepartment of Hematology, Shanxi Cancer Hospital, Taiyuan, China.
Hongmei YuDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China.
Lei WangDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China.
Chuchu ZhengDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China.
Xueqian HuangDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China.
Zhenhuan YangDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China.
Meng XingDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China.
Qing LuDepartment of Epidemiology and Biostatistics, Michigan State University, East Lansing, USA. lucienq@hotmail.com.
Yanhong LuoDepartment of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, China. sxmulyh@163.com.ORCID 0000-0002-0943-4169

Funding

Computational Efficient Statistical Tools for Analyzing Substance Dependence Sequencing DataR01DA043501 · NIDA · UNIVERSITY OF FLORIDA · PI LU, QING · 2017 to 2021
$2.1M
Methods and Software for High-dimensional Risk Prediction ResearchR01LM012848 · NLM · UNIVERSITY OF FLORIDA · PI LU, QING · 2018 to 2021
$1.2M
NIDA NIH HHS R01 DA043501NLM NIH HHS R01 LM012848
6 · The paper itself

Abstract

backgroundUnder the influences of chemotherapy regimens, clinical staging, immunologic expressions and other factors, the survival rates of patients with diffuse large B-cell lymphoma (DLBCL) are different. The accurate prediction of mortality hazards is key to precision medicine, which can help clinicians make optimal therapeutic decisions to extend the survival times of individual patients with DLBCL. Thus, we have developed a predictive model to predict the mortality hazard of DLBCL patients within 2 years of treatment.

methodsWe evaluated 406 patients with DLBCL and collected 17 variables from each patient. The predictive variables were selected by the Cox model, the logistic model and the random forest algorithm. Five classifiers were chosen as the base models for ensemble learning: the naïve Bayes, logistic regression, random forest, support vector machine and feedforward neural network models. We first calibrated the biased outputs from the five base models by using probability calibration methods (including shape-restricted polynomial regression, Platt scaling and isotonic regression). Then, we aggregated the outputs from the various base models to predict the 2-year mortality of DLBCL patients by using three strategies (stacking, simple averaging and weighted averaging). Finally, we assessed model performance over 300 hold-out tests.

resultsGender, stage, IPI, KPS and rituximab were significant factors for predicting the deaths of DLBCL patients within 2 years of treatment. The stacking model that first calibrated the base model by shape-restricted polynomial regression performed best (AUC = 0.820, ECE = 8.983, MCE = 21.265) in all methods. In contrast, the performance of the stacking model without undergoing probability calibration is inferior (AUC = 0.806, ECE = 9.866, MCE = 24.850). In the simple averaging model and weighted averaging model, the prediction error of the ensemble model also decreased with probability calibration.

conclusionsAmong all the methods compared, the proposed model has the lowest prediction error when predicting the 2-year mortality of DLBCL patients. These promising results may indicate that our modeling strategy of applying probability calibration to ensemble learning is successful.

Indexed as

Lymphoma, Large B-Cell, DiffuseBayes TheoremCalibrationHumansLogistic ModelsPrognosisCalibrationDiscriminationDLBCLEnsemble methodProbability calibrationRisk prediction

Identifiers

PMID33413321
PMCPMC7791789

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.