Evidence map›Paper›PMID 39690114›Full record

ArticleJournal of magnetic resonance imaging : JMRI2025

Incorporating Radiologist Knowledge Into MRI Quality Metrics for Machine Learning Using Rank-Based Ratings.

Chenwei Tang, Laura B Eisenmenger, Leonardo Rivera-Rivera, Eugene Huo, Jacqueline C Junn, Anthony D Kuner, Thekla H Oechtering, Anthony Peret, Jitka Starekova, Kevin M Johnson

Abstract read
In one paragraph

Article in Journal of magnetic resonance imaging : JMRI, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Chenwei TangDepartment of Medical Physics, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.ORCID 0000-0001-8140-0548
Laura B EisenmengerDepartment of Radiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.
Leonardo Rivera-RiveraDepartment of Medical Physics, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.ORCID 0000-0001-5629-8721
Eugene HuoDepartment of Radiology, University of California, San Francisco, California, USA.
Jacqueline C JunnDepartment of Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA.
Anthony D KunerDepartment of Radiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.
Thekla H OechteringDepartment of Radiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.
Anthony PeretDepartment of Radiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.
Jitka StarekovaDepartment of Radiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.ORCID 0000-0002-4285-3090
Kevin M JohnsonDepartment of Medical Physics, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.

Funding

Non-Invasive Imaging Markers to Elicit the Role of Vascular Involvement in Alzheimer’s DiseaseR01AG075788 · NIA · UNIVERSITY OF WISCONSIN-MADISON · PI Kevin Michael Johnson · 2022 to 2026
$3.2M
Characterizing the Effect of Altered CSF and Blood Flow Dynamics on Alzheimer’s Disease Proteinopathy, Brain Health, and CognitionR21AG077337 · NIA · UNIVERSITY OF WISCONSIN-MADISON · PI RIVERA RIVERA, LEONARDO A · 2022 to 2022
$428k
Optimizing MRI for Neurologic Screening using Radiologist CrowdsourcingR21NS125094 · NINDS · UNIVERSITY OF WISCONSIN-MADISON · PI JOHNSON, KEVIN MICHAEL · 2022 to 2022
$414k
Deutsche Forschungsgemeinschaft OE 746/1-1NIA NIH HHS R01 AG075788NIA NIH HHS R01AG075788NIA NIH HHS R21 AG077337NIA NIH HHS R21AG077337NINDS NIH HHS R21 NS125094NINDS NIH HHS R21NS125094
6 · The paper itself

Abstract

backgroundDeep learning (DL) often requires an image quality metric; however, widely used metrics are not designed for medical images. PURPOSE: To develop an image quality metric that is specific to MRI using radiologists image rankings and DL models. STUDY TYPE: Retrospective. POPULATION: A total of 19,344 rankings on 2916 unique image pairs from the NYU fastMRI Initiative neuro database was used for the neural network-based image quality metrics training with an 80%/20% training/validation split and fivefold cross-validation. FIELD STRENGTH/SEQUENCE: 1.5 T and 3 T T1, T1 postcontrast, T2, and FLuid Attenuated Inversion Recovery (FLAIR). ASSESSMENT: Synthetically corrupted image pairs were ranked by radiologists (N = 7), with a subset also scoring images using a Likert scale (N = 2). DL models were trained to match rankings using two architectures (EfficientNet and IQ-Net) with and without reference image subtraction and compared to ranking based on mean squared error (MSE) and structural similarity (SSIM). Image quality assessing DL models were evaluated as alternatives to MSE and SSIM as optimization targets for DL denoising and reconstruction. STATISTICAL TESTS: Radiologists' agreement was assessed by a percentage metric and quadratic weighted Cohen's kappa. Ranking accuracies were compared using repeated measurements analysis of variance. Reconstruction models trained with IQ-Net score, MSE and SSIM were compared by paired t test. P < 0.05 was considered significant.

resultsCompared to direct Likert scoring, ranking produced a higher level of agreement between radiologists (70.4% vs. 25%). Image ranking was subjective with a high level of intraobserver agreement ( DATA

conclusionImage quality networks can be trained from image ranking and used to optimize DL tasks. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY: Stage 1.

Indexed as

Image Interpretation, Computer-AssistedImage Processing, Computer-AssistedMachine LearningMagnetic Resonance ImagingRadiologistsAlgorithmsBrainDatabases, FactualDeep LearningHumansNeural Networks, ComputerReproducibility of ResultsRetrospective Studiesdeep learningimage quality metricsimage reconstruction

Identifiers

PMID39690114
PMCPMC12063763

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.