Evidence map›Paper›PMID 34167765›Full record

ArticleThe Lancet. Digital health2021

An integrated nomogram combining deep learning, Prostate Imaging-Reporting and Data System (PI-RADS) scoring, and clinical variables for identification of clinically significant prostate cancer on biparametric MRI: a retrospective multicentre study.

Amogh Hiremath, Rakesh Shiradkar, Pingfu Fu, Amr Mahran, Ardeshir R Rastinehad, Ashutosh Tewari, Sree Harsha Tirumani, Andrei Purysko, Lee Ponsky, Anant Madabhushi

Open access · goldAbstract readComparative StudyMulticenter Study
In one paragraph

Article in The Lancet. Digital health, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 72 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
72citing papers in PubMed, 2 pooled it
12.5field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

72 citing papers in PubMed, 2 syntheses or guidelines pooled it, 111 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Article
  6. Multimodal Nomogram for the Prenatal Risk Assessment of Hypoplastic Left Heart Syndrome Using Self-Supervised Learning.Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine · 2026
    Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Review
  20. Article

12 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 6 institutions in 1 country.

Amogh HiremathDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.
Rakesh ShiradkarDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.
Pingfu FuDepartment of Population and Quantitative Health Sciences, Case Western Reserve University, Cleveland, OH, USA.
Amr MahranUrology Institute, University Hospitals Cleveland Medical Center, Cleveland, OH, USA.
Ardeshir R RastinehadDepartment of Urology, Lenox Hill Hospital, Northwell Health, New York, NY, USA.
Ashutosh TewariDepartment of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
Sree Harsha TirumaniDepartment of Radiology, University Hospitals Cleveland Medical Center, Cleveland, OH, USA.
Andrei PuryskoDepartment of Radiology and Nuclear Medicine, Cleveland Clinic, Cleveland, OH, USA.
Lee PonskyUrology Institute, University Hospitals Cleveland Medical Center, Cleveland, OH, USA.
Anant MadabhushiDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA; Louis Stokes Cleveland Veterans Administration Medical Center, Cleveland, OH, USA. Electronic address: axm788@case.edu.
Case Western Reserve University · USUniversity Hospitals of Cleveland · USCleveland Clinic · USIcahn School of Medicine at Mount Sinai · USLenox Hill Hospital · USLouis Stokes Cleveland VA Medical Center · US

Funding

Clinical and Translational Science Collaborative of ClevelandUL1TR002548 · NCATS · CASE WESTERN RESERVE UNIVERSITY · PI MCCOMSEY, GRACE A · 2018 to 2022
$35.5M
Computer-Assisted Histologic Evaluation of Cardiac Allograft RejectionR01HL151277 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI MADABHUSHI, ANANT, MARGULIES, KENNETH BER · 2020 to 2023
$3.2M
Oral Cavity Quantitative Histomorphometric Risk Classifier (OHbIC) in Oral Cavity Squamous Cell Carcinoma (OC-SCC)R01CA249992 · NCI · EMORY UNIVERSITY · PI LEWIS, JAMES, MADABHUSHI, ANANT · 2021 to 2025
$3.2M
Computerized histologic image predictor of cancer outcomeR01CA202752 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI FELDMAN, MICHAEL D, GANESAN, SHRIDAR · 2016 to 2020
$3.1M
Quantitative Histomorphometric Risk Classifier (QuHbIC) in HPV + Oropharyngeal CarcinomaR01CA220581 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI KOYFMAN, SHLOMO, LEWIS, JAMES · 2018 to 2023
$3.1M
Computerized Histologic Risk Predictor (CHiRP) for Early Stage Lung CancersR01CA216579 · NCI · EMORY UNIVERSITY · PI FU, PINGFU, LLOYD, MARK · 2018 to 2023
$3.1M
MR Fingerprinting and Computerized Decision Support for Prostate CancerR01CA208236 · NCI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI GULANI, VIKAS, PONSKY, LEE EVAN · 2017 to 2022
$3.0M
Pathology Image Informatics Platform for visualization, analysis and managementU24CA199374 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI GURCAN, METIN NAFI, MADABHUSHI, ANANT · 2015 to 2019
$2.9M
Novel Radiomics for Predicting Response to Immunotherapy for Lung CancerR01CA257612 · NCI · EMORY UNIVERSITY · PI Anant Madabhushi, Vamsidhar Velcheti · 2021 to 2026
$2.7M
RadxTools for assessing tumor treatment response on imagingU01CA248226 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI TIWARI, PALLAVI, VISWANATH, SATISH EASWAR · 2020 to 2022
$1.4M
HistoTools: A suite of digital pathology tools for quality control, annotation and dataset identificationU01CA239055 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI JANOWCZYK, ANDREW ROBERT, MADABHUSHI, ANANT · 2019 to 2022
$1.0M
Systems biology frameworks to unravel mechanisms driving complex disordersK25DK115904 · NIDDK · CASE WESTERN RESERVE UNIVERSITY · PI VARADAN, VINAY · 2019 to 2021
$515k
BLRD VA I01 BX004121BLRD VA IK6 BX006185NCATS NIH HHS UL1 TR002548NCI NIH HHS R01 CA202752NCI NIH HHS R01 CA208236NCI NIH HHS R01 CA216579NCI NIH HHS R01 CA220581NCI NIH HHS R01 CA249992NCI NIH HHS R01 CA257612NCI NIH HHS U01 CA239055NCI NIH HHS U01 CA248226NCI NIH HHS U24 CA199374NCRR NIH HHS C06 RR012463NHLBI NIH HHS R01 HL151277NIBIB NIH HHS R43 EB028736NIDDK NIH HHS K25 DK115904
6 · The paper itself

Abstract

backgroundBiparametric MRI (comprising T2-weighted MRI and apparent diffusion coefficient maps) is increasingly being used to characterise prostate cancer. Although previous studies have combined Prostate Imaging-Reporting & Data System (PI-RADS)-based MRI findings with routinely available clinical variables and with deep learning-based imaging predictors, respectively, for prostate cancer risk stratification, none have combined all three. We aimed to construct an integrated nomogram (referred to as ClaD) combining deep learning-based imaging predictions, PI-RADS scoring, and clinical variables to identify clinically significant prostate cancer on biparametric MRI.

methodsIn this retrospective multicentre study, we included patients with prostate cancer, with histopathology or biopsy reports and a screening or diagnostic MRI scan in the axial view, from four cohorts in the USA (from University Hospitals Cleveland Medical Center, Icahn School of Medicine at Mount Sinai, Cleveland Clinic, and Long Island Jewish Medical Center) and from the PROSTATEx Challenge dataset in the Netherlands. We constructed an integrated nomogram combining deep learning, PI-RADS score, and clinical variables (prostate-specific antigen, prostate volume, and lesion volume) using multivariable logistic regression to identify clinically significant prostate cancer on biparametric MRI. We used data from the first three cohorts to train the nomogram and data from the remaining two cohorts for independent validation. We compared the performance of our ClaD integrated nomogram with that of integrated nomograms combining clinical variables with either the deep learning-based imaging predictor (referred to as DIN) or PI-RADS score (referred to as PIN) using area under the receiver operating characteristic curves (AUCs). We also compared the ability of the nomograms to predict biochemical recurrence on a subset of patients who had undergone radical prostatectomy. We report cross-validation AUCs as means for the training set and used AUCs with 95% CIs to assess the performance on the test set. The difference in AUCs between the models were tested for statistical significance using DeLong's test. We used log-rank tests and Kaplan-Meier curves to analyse survival.

findingsWe investigated 592 patients (823 lesions) with prostate cancer who underwent 3T multiparametric MRI at five hospitals in the USA between Jan 8, 2009, and June 3, 2017. The training data set consisted of 368 patients from three sites (the PROSTATEx Challenge cohort [n=204], University Hospitals Cleveland Medical Center [n=126], and Icahn School of Medicine at Mount Sinai [n=38]), and the independent validation data set consisted of 224 patients from two sites (Cleveland Clinic [n=151] and Long Island Jewish Medical Center [n=73]). The ClaD clinical nomogram yielded an AUC of 0·81 (95% CI 0·76-0·85) for identification of clinically significant prostate cancer in the validation data set, significantly improving performance over the DIN (0·74 [95% CI 0·69-0·80], p=0·0005) and PIN (0·76 [0·71-0·81], p<0·0001) nomograms. In the subset of patients who had undergone radical prostatectomy (n=81), the ClaD clinical nomogram resulted in a significant separation in Kaplan-Meier survival curves between patients with and without biochemical recurrence (HR 5·92 [2·34-15·00], p=0·044), whereas the DIN (1·22 [0·54-2·79], p=0·65) and PIN nomograms did not (1·30 [0·62-2·71], p=0·51).

interpretationRisk stratification of patients with prostate cancer using the integrated ClaD nomogram could help to identify patients with prostate cancer who are at low risk, very low risk, and favourable intermediate risk, who might be candidates for active surveillance, and could also help to identify patients with lethal prostate cancer who might benefit from adjuvant therapy.

fundingNational Cancer Institute of the US National Institutes of Health, National Institute for Biomedical Imaging and Bioengineering, National Center for Research Resources, US Department of Veterans Affairs Biomedical Laboratory Research and Development Service, US Department of Defense, US National Institute of Diabetes and Digestive and Kidney Diseases, The Ohio Third Frontier Technology Validation Fund, Case Western Reserve University, Dana Foundation, and Clinical and Translational Science Collaborative.

Indexed as

Deep LearningMultiparametric Magnetic Resonance ImagingNomogramsData SystemsHumansMaleProstatic NeoplasmsResearch DesignRetrospective Studies

Identifiers

PMID34167765
PMCPMC8261599
OpenAlexW3175189459

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.