Evidence map›Paper›PMID 34327583›Full record

ArticleEuropean radiology2022

Inter-reader agreement of the PI-QUAL score for prostate MRI quality in the NeuroSAFE PROOF trial.

Francesco Giganti, Eoin Dinneen, Veeru Kasivisvanathan, Aiman Haider, Alex Freeman, Alex Kirkham, Shonit Punwani, Mark Emberton, Greg Shaw, Caroline M Moore and 1 more

Open access · hybridAbstract read
In one paragraph

Article in European radiology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed
6.5field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 50 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 2 institutions in 1 country.

Francesco GigantiDepartment of Radiology, University College London Hospital NHS Foundation Trust, London, UK. f.giganti@ucl.ac.uk.ORCID http://orcid.org/0000-0001-5218-6431
Eoin DinneenDivision of Surgery & Interventional Science, University College London, 3rd Floor, Charles Bell House, 43-45 Foley St, London, W1W 7TS, UK.
Veeru KasivisvanathanDivision of Surgery & Interventional Science, University College London, 3rd Floor, Charles Bell House, 43-45 Foley St, London, W1W 7TS, UK.
Aiman HaiderDepartment of Pathology, University College London Hospital NHS Foundation Trust, London, UK.
Alex FreemanDepartment of Pathology, University College London Hospital NHS Foundation Trust, London, UK.
Alex KirkhamDepartment of Radiology, University College London Hospital NHS Foundation Trust, London, UK.
Shonit PunwaniDepartment of Radiology, University College London Hospital NHS Foundation Trust, London, UK.
Mark EmbertonDivision of Surgery & Interventional Science, University College London, 3rd Floor, Charles Bell House, 43-45 Foley St, London, W1W 7TS, UK.
Greg ShawDivision of Surgery & Interventional Science, University College London, 3rd Floor, Charles Bell House, 43-45 Foley St, London, W1W 7TS, UK.
Caroline M MooreDivision of Surgery & Interventional Science, University College London, 3rd Floor, Charles Bell House, 43-45 Foley St, London, W1W 7TS, UK.
Clare AllenDepartment of Radiology, University College London Hospital NHS Foundation Trust, London, UK.
University College London Hospitals NHS Foundation Trust · GBUniversity College Hospital · GB

Funding

National Institute for Health Research PB-PG- 1216-20013
6 · The paper itself

Abstract

objectivesThe Prostate Imaging Quality (PI-QUAL) score assesses the quality of multiparametric MRI (mpMRI). A score of 1 means all sequences are below the minimum standard of diagnostic quality, 3 implies that the scan is of sufficient diagnostic quality, and 5 means that all three sequences are of optimal diagnostic quality. We investigated the inter-reader reproducibility of the PI-QUAL score in patients enrolled in the NeuroSAFE PROOF trial.

methodsWe analysed the scans of 103 patients on different MR systems and vendors from 12 different hospitals. Two dedicated radiologists highly experienced in prostate mpMRI independently assessed the PI-QUAL score for each scan. Interobserver agreement was assessed using Cohen's kappa with standard quadratic weighting (κw) and percent agreement.

resultsThe agreement for each single PI-QUAL score was strong (κw = 0.85 and percent agreement = 84%). A similar agreement (κw = 0.82 and percent agreement = 84%) was observed when the scans were clustered into three groups (PI-QUAL 1-2 vs PI-QUAL 3 vs PI-QUAL 4-5). The agreement in terms of diagnostic quality for each single sequence was highest for T2-weighted imaging (92/103 scans; 89%), followed by dynamic contrast-enhanced sequences (91/103; 88%) and diffusion-weighted imaging (80/103; 78%).

conclusionWe observed strong reproducibility in the assessment of PI-QUAL between two radiologists with high expertise in prostate mpMRI. At present, PI-QUAL offers clinicians the only available tool for evaluating and reporting the quality of prostate mpMRI in a systematic manner but further refinements of this scoring system are warranted. KEY POINTS: • Inter-reader agreement for each single Prostate Imaging Quality (PI-QUAL) score (i.e., PI-QUAL 1 to PI-QUAL 5) was strong, with weighted kappa = 0.85 (95% confidence intervals: 0.51 - 1) and percent agreement = 84%. • Interobserver agreement was strong when the scans were clustered into three groups according to the ability (or not) to rule in and to rule out clinically significant prostate cancer (i.e., PI-QUAL 1-2 vs PI-QUAL 3 vs PI-QUAL 4-5), with weighted kappa = 0.82 (95% confidence intervals: 0.68 - 0.96) and percent agreement = 84%. • T2-weighted acquisitions were the most compliant with the Prostate Imaging Reporting and Data System (PI-RADS) v. 2.0 technical recommendations and were the sequences of highest diagnostic quality for both readers in 95/103 (92%) scans, followed by dynamic contrast enhanced acquisition with 81/103 (79%) scans and lastly by diffusion-weighted imaging with 79/103 (77%) scans.

Indexed as

ProstateProstatic NeoplasmsHumansMagnetic Resonance ImagingMaleReproducibility of ResultsRetrospective StudiesMagnetic resonance imagingProstatic neoplasmsUrogenital neoplasms

Identifiers

PMID34327583
PMCPMC8794934
OpenAlexW3183416008

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.