Evidence map›Paper›PMID 40802002›Full record

ArticleInsights into imaging2025

Explanation and Elaboration with Examples for METRICS (METRICS-E3): an initiative from the EuSoMII Radiomics Auditing Group.

Burak Kocak, Angela Ammirabile, Ilaria Ambrosini, Tugba Akinci D'Antonoli, Alessandra Borgheresi, Armando Ugo Cavallo, Roberto Cannella, Gennaro D'Anna, Oliver Díaz, Fabio M Doniselli and 9 more

Abstract read
In one paragraph

Article in Insights into imaging, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Review
  6. Article
  7. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors.

Burak KocakDepartment of Radiology, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey. drburakkocak@gmail.com.ORCID http://orcid.org/0000-0002-7307-396X
Angela AmmirabileDepartment of Biomedical Sciences, Humanitas University, Milan, Italy.ORCID http://orcid.org/0000-0002-3724-053X
Ilaria AmbrosiniDepartment of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy.ORCID http://orcid.org/0000-0002-0026-9101
Tugba Akinci D'AntonoliDepartment of Diagnostic and Interventional Neuroradiology, University Hospital Basel, Basel, Switzerland.ORCID http://orcid.org/0000-0002-7237-711X
Alessandra BorgheresiDepartment of Clinical, Special and Dental Sciences, University Politecnica delle Marche, Ancona, Italy.ORCID http://orcid.org/0000-0002-5544-9468
Armando Ugo CavalloDivision of Radiology, Istituto Dermopatico dell'Immacolata, IRCCS, Rome, Italy.ORCID http://orcid.org/0000-0001-8390-7721
Roberto CannellaDepartment of Biomedicine, Neuroscience, and Advanced Diagnostics (Bi.N.D.), University of Palermo, Palermo, Italy.ORCID http://orcid.org/0000-0002-3808-0785
Gennaro D'AnnaDepartment of Diagnostic Imaging and Stereotactic Radiosurgery, Centro Diagnostico Italiano S.p.A., Milan, Italy.ORCID http://orcid.org/0000-0001-9890-9359
Oliver DíazDepartament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain.ORCID http://orcid.org/0000-0001-6789-5177
Fabio M DoniselliNeuroradiology Unit, Fondazione Istituto Neurologico Carlo Besta, Milano, Italy.ORCID http://orcid.org/0000-0002-2272-7855
Salvatore Claudio FanniDepartment of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy.ORCID http://orcid.org/0000-0002-4003-3320
Samuele GhezzoNuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy.ORCID http://orcid.org/0000-0002-7765-6759
Kevin B W Groot LipmanDepartment of Radiology, Netherlands Cancer Institute, Amsterdam, the Netherlands.ORCID http://orcid.org/0000-0003-3651-2529
Michail E KlontzasArtificial Intelligence and Translational Imaging (ATI) Lab, Department of Radiology, School of Medicine, University of Crete, Heraklion, Greece.ORCID http://orcid.org/0000-0003-2731-933X
Andrea PonsiglioneDepartment of Advanced Biomedical Sciences, University of Naples Federico II, Naples, Italy.ORCID http://orcid.org/0000-0002-0105-935X
Arnaldo StanzioneDepartment of Advanced Biomedical Sciences, University of Naples Federico II, Naples, Italy.ORCID http://orcid.org/0000-0002-7905-5789
Matthaios TriantafyllouDepartment of Medical Imaging, University Hospital of Heraklion, Crete, Greece.ORCID http://orcid.org/0000-0003-0159-5424
Federica VernuccioDepartment of Biomedicine, Neuroscience, and Advanced Diagnostics (Bi.N.D.), University of Palermo, Palermo, Italy.ORCID http://orcid.org/0000-0003-0350-1794
Renato CuocoloDepartment of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy.ORCID http://orcid.org/0000-0002-1452-1574

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Radiomics research has been hindered by inconsistent and often poor methodological quality, limiting its potential for clinical translation. To address this challenge, the METhodological RadiomICs Score (METRICS) was recently introduced as a tool for systematically assessing study rigor. However, its effective application requires clearer guidance. The METRICS-E3 (Explanation and Elaboration with Examples) resource was developed by the European Society of Medical Imaging Informatics-Radiomics Auditing Group in response. This international initiative provides comprehensive support for users by offering detailed rationales, interpretive guidance, scoring recommendations, and illustrative examples for each METRICS item and condition. Each criterion includes positive examples from peer-reviewed, open-access studies and hypothetical negative examples. In total, the finalized METRICS-E3 includes over 200 examples. The complete resource is publicly available through an interactive website. CRITICAL RELEVANCE STATEMENT: METRICS-E3 offers deeper insights into each METRICS item and condition, providing concrete examples with accompanying commentary and recommendations to enhance the evaluation of methodological quality in radiomics research. KEY POINTS: As a complementary initiative to METRICS, METRICS-E3 is intended to support stakeholders in evaluating the methodological aspects of radiomics studies. In METRICS-E3, each METRICS item and condition is supplemented with interpretive guidance, positive literature-based examples, hypothetical negative examples, and scoring recommendations. The complete METRICS-E3 explanation and elaboration resource is accessible at its interactive website.

Indexed as

Artificial intelligenceGuidelineMachine learningQuality assessmentRadiomics

Identifiers

PMID40802002
PMCPMC12351001

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.