Evidence map›Paper›PMID 34455593›Full record

ReviewMedical physics2022

Challenges in ensuring the generalizability of image quantitation methods for MRI.

Kathryn E Keenan, Jana G Delfino, Kalina V Jordanova, Megan E Poorman, Prathyush Chirra, Akshay S Chaudhari, Bettina Baessler, Jessica Winfield, Satish E Viswanath, Nandita M deSouza

Abstract readReview
In one paragraph

Review in Medical physics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Color-map recommendation for MR relaxometry maps.Magnetic resonance in medicine · 2025
    Article
  9. Data Harmonization with StyleTransfer-GANs: Enhancing Non-Invasive IDH Classification in Brain Tumors.Proceedings of SPIE--the International Society for Optical Engineering · 2025
    Article
  10. Review
  11. Review
  12. The Diagnostic Performance ofIranian journal of public health · 2024
    Review
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Kathryn E KeenanPhysical Measurement Laboratory, National Institute of Standards and Technology, Boulder, Colorado, USA.
Jana G DelfinoCenter for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland, USA.
Kalina V JordanovaPhysical Measurement Laboratory, National Institute of Standards and Technology, Boulder, Colorado, USA.
Megan E PoormanPhysical Measurement Laboratory, National Institute of Standards and Technology, Boulder, Colorado, USA.
Prathyush ChirraDept of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio, USA.
Akshay S ChaudhariDepartment of Radiology, Stanford University, Stanford, California, USA.
Bettina BaesslerUniversity Hospital of Zurich and University of Zurich, Zurich, Switzerland.
Jessica WinfieldCancer Research UK Cancer Imaging Centre, Division of Radiotherapy and Imaging, The Institute of Cancer Research, London, UK.
Satish E ViswanathDept of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio, USA.
Nandita M deSouzaCancer Research UK Cancer Imaging Centre, Division of Radiotherapy and Imaging, The Institute of Cancer Research, London, UK.

Funding

Training and DisseminationP41EB015891 · NIBIB · STANFORD UNIVERSITY · PI GLOVER, GARY H · 2012 to 2019
$10.7M
Rapid MRI for Evaluation of OsteoarthritisR01EB002524 · NIBIB · STANFORD UNIVERSITY · PI Akshay Chaudhari, Garry E Gold · 2003 to 2026
$10.1M
Rapid Low-Cost Quantitative 3D MRI and Gait Assessment of the KneeR01AR077604 · NIAMS · STANFORD UNIVERSITY · PI HARGREAVES, BRIAN ANDREW · 2020 to 2024
$3.2M
Development of Sodium Fluoride PET-MRI for Quantitative Assessment of Knee OsteoarthritisR01AR074492 · NIAMS · STANFORD UNIVERSITY · PI GOLD, GARRY E · 2019 to 2023
$2.4M
Advanced MR Imaging of Early OsteoarthritisK24AR062068 · NIAMS · STANFORD UNIVERSITY · PI GOLD, GARRY E · 2012 to 2022
$1.7M
RadxTools for assessing tumor treatment response on imagingU01CA248226 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI TIWARI, PALLAVI, VISWANATH, SATISH EASWAR · 2020 to 2022
$1.4M
Cancer Research UK 16464Intramural NIST DOC 9999-NISTNCI NIH HHS U01 CA248226NIAMS NIH HHS K24 AR062068NIAMS NIH HHS R01 AR074492NIAMS NIH HHS R01 AR077604NIBIB NIH HHS P41 EB015891NIBIB NIH HHS R01 EB002524NIH HHS K24 AR062068NIH HHS P41 EB015891NIH HHS R01 AR077604NIH HHS R01 EB002524
6 · The paper itself

Abstract

Image quantitation methods including quantitative MRI, multiparametric MRI, and radiomics offer great promise for clinical use. However, many of these methods have limited clinical adoption, in part due to issues of generalizability, that is, the ability to translate methods and models across institutions. Researchers can assess generalizability through measurement of repeatability and reproducibility, thus quantifying different aspects of measurement variance. In this article, we review the challenges to ensuring repeatability and reproducibility of image quantitation methods as well as present strategies to minimize their variance to enable wider clinical implementation. We present possible solutions for achieving clinically acceptable performance of image quantitation methods and briefly discuss the impact of minimizing variance and achieving generalizability towards clinical implementation and adoption.

Indexed as

Magnetic Resonance ImagingMultiparametric Magnetic Resonance ImagingReproducibility of Resultsmagnetic resonance imagingmultiparametric MRIquantitative MRIradiomics

Identifiers

PMID34455593
PMCPMC8882689

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.