Evidence map›Paper›PMID 24919831›Full record

ReviewStatistical methods in medical research2015

Quantitative imaging biomarkers: a review of statistical methods for technical performance assessment.

David L Raunig, Lisa M McShane, Gene Pennello, Constantine Gatsonis, Paul L Carson, James T Voyvodic, Richard L Wahl, Brenda F Kurland, Adam J Schwarz, Mithat Gönen and 8 more

Abstract readReview
In one paragraph

Review in Statistical methods in medical research, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 226 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
226citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

226 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Trial
  8. Reproducibility and Repeatability of SemiquantitativeJournal of nuclear medicine : official publication, Society of Nuclear Medicine · 2018
    Trial
  9. Repeatability of Quantitative 18F-NaF PET: A Multicenter Study.Journal of nuclear medicine : official publication, Society of Nuclear Medicine · 2016
    Trial
  10. Article
  11. Article
  12. Simultaneous TMagnetic resonance in medicine · 2026
    Article
  13. The Next Frontier in Quantitative Co-Clinical Imaging to Advance Functional Precision Oncology.Clinical cancer research : an official journal of the American Association for Cancer Research · 2026
    Article
  14. [EJNMMI research · 2026
    Article
  15. Article
  16. Article
  17. Comparability of Centiloid values from [Neuroimage. Reports · 2026
    Article
  18. Review
  19. Review
  20. Article

166 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

David L RaunigICON Medical Imaging, Warrington, USA David.Raunig@iconplc.com.
Lisa M McShaneNational Cancer Institute, Bethesda, USA.
Gene PennelloFood and Drug Administration/CDRH, Silver Spring, USA.
Constantine GatsonisBrown University, Providence, USA.
Paul L CarsonUniversity of Michigan Health System, Ann Arbor, USA.
James T VoyvodicDuke University BIAC, Durham, USA.
Richard L WahlJohns Hopkins Medical Institute, Baltimore, MD, USA.
Brenda F KurlandUniversity of Pittsburgh, Pittsburg, USA.
Adam J SchwarzEli Lilly and Co, Indianapolis, USA.
Mithat GönenMemorial Sloan Kettering Cancer Center, New York, USA.
Gudrun ZahlmannHoffman-La Roche Ltd., Basel, CH.
Marina V KondratovichFood and Drug Administration/CDRH, Silver Spring, USA.
Kevin O'DonnellToshiba Medical Research Institute, Vernon Hills, USA.
Nicholas PetrickFood and Drug Administration/CDRH, Silver Spring, USA.
Patricia E ColeTakaeda, Deerfield, USA.
Brian GarraFood and Drug Administration/CDRH, Silver Spring, USA.
Daniel C SullivanDuke University School of Medicine, Durham, USA.
QIBA Technical Performance Working Group

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
Statistics CoreU10CA180794 · NCI · DANA-FARBER CANCER INST · PI PAUL J CATALANO, CONSTANTINE A. GATSONIS · 2014 to 2026
$111.2M
NCI NIH HHS P30 CA008748NCI NIH HHS U10 CA180794NIBIB NIH HHS HHSN268201000050C
6 · The paper itself

Abstract

Technological developments and greater rigor in the quantitative measurement of biological features in medical images have given rise to an increased interest in using quantitative imaging biomarkers to measure changes in these features. Critical to the performance of a quantitative imaging biomarker in preclinical or clinical settings are three primary metrology areas of interest: measurement linearity and bias, repeatability, and the ability to consistently reproduce equivalent results when conditions change, as would be expected in any clinical trial. Unfortunately, performance studies to date differ greatly in designs, analysis method, and metrics used to assess a quantitative imaging biomarker for clinical use. It is therefore difficult or not possible to integrate results from different studies or to use reported results to design studies. The Radiological Society of North America and the Quantitative Imaging Biomarker Alliance with technical, radiological, and statistical experts developed a set of technical performance analysis methods, metrics, and study designs that provide terminology, metrics, and methods consistent with widely accepted metrological standards. This document provides a consistent framework for the conduct and evaluation of quantitative imaging biomarker performance studies so that results from multiple studies can be compared, contrasted, or combined.

Indexed as

BiomarkersDiagnostic ImagingResearch DesignStatistics as TopicBiasClinical Trials as TopicHumansReproducibility of ResultsTerminology as TopicBiomarkersagreementbiasimaging biomarkerslinearityprecisionquantitative imagingreliabilityrepeatabilityreproducibility

Identifiers

PMID24919831
PMCPMC5574197

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.