Evidence map›Paper›PMID 38360049›Full record

ArticleJournal of nuclear medicine : official publication, Society of Nuclear Medicine2024

Need for Objective Task-Based Evaluation of Image Segmentation Algorithms for Quantitative PET: A Study with ACRIN 6668/RTOG 0235 Multicenter Clinical Trial Data.

Ziping Liu, Joyce C Mhlanga, Huitian Xia, Barry A Siegel, Abhinav K Jha

Abstract read
In one paragraph

Article in Journal of nuclear medicine : official publication, Society of Nuclear Medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. No-gold-standard evaluation of quantitative imaging methods in the presence of correlated noise.Proceedings of SPIE--the International Society for Optical Engineering
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Ziping LiuDepartment of Biomedical Engineering, Washington University, St. Louis, Missouri.
Joyce C MhlangaMallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, Missouri; and.
Huitian XiaDepartment of Biomedical Engineering, Washington University, St. Louis, Missouri.
Barry A SiegelMallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, Missouri; and.
Abhinav K JhaDepartment of Biomedical Engineering, Washington University, St. Louis, Missouri; a.jha@wustl.edu.

Funding

Validation and dissemination of novel physical phantoms for quantitative theranostics researchR01EB031962 · NIBIB · WASHINGTON UNIVERSITY · PI JHA, ABHINAV K · 2022 to 2025
$2.4M
A no-gold-standard framework to objectively evaluate quantitative imaging methods with patient dataR01EB031051 · NIBIB · WASHINGTON UNIVERSITY · PI JHA, ABHINAV K · 2021 to 2025
$2.1M
A fully automated PET radiomics frameworkR56EB028287 · NIBIB · WASHINGTON UNIVERSITY · PI JHA, ABHINAV K · 2021 to 2021
$493k
Transmission-less attenuation and scatter compensation in myocardial perfusion SPECT with list-mode dataR21EB024647 · NIBIB · WASHINGTON UNIVERSITY · PI JHA, ABHINAV K · 2018 to 2019
$430k
NIBIB NIH HHS R01 EB031051NIBIB NIH HHS R01 EB031962NIBIB NIH HHS R21 EB024647NIBIB NIH HHS R56 EB028287
6 · The paper itself

Abstract

Reliable performance of PET segmentation algorithms on clinically relevant tasks is required for their clinical translation. However, these algorithms are typically evaluated using figures of merit (FoMs) that are not explicitly designed to correlate with clinical task performance. Such FoMs include the Dice similarity coefficient (DSC), the Jaccard similarity coefficient (JSC), and the Hausdorff distance (HD). The objective of this study was to investigate whether evaluating PET segmentation algorithms using these task-agnostic FoMs yields interpretations consistent with evaluation on clinically relevant quantitative tasks.

Indexed as

Carcinoma, Non-Small-Cell LungLung NeoplasmsAlgorithmsClinical Trials as TopicHumansImage Processing, Computer-AssistedMulticenter Studies as TopicPositron-Emission TomographyRetrospective Studiesartificial intelligencedeep learningmulticenter clinical trialquantitative imagingsegmentationtask-based evaluation

Identifiers

PMID38360049
PMCPMC10924158

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.