ArticleBMC medical imaging2020
Interobserver variability in quality assessment of magnetic resonance images.
Article in BMC medical imaging, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
23 citing papers in PubMed.
- Radiomics-based MRI model for predicting the severity of rotator cuff tears.Orthopadie (Heidelberg, Germany) · 2026Article
- Deep learning reconstruction-applied PROPELLER diffusion-weighted imaging in uterine malignancies: a comparison study with MUSE.Japanese journal of radiology · 2026Article
- AI-powered evaluation of dementia severity based on clinical data and visual scoring systems (MTA, ERICA, GCA) from MRI.Scientific reports · 2026Article
- Comparison of observed image quality and technical image quality parameters in 3D-FLAIR images.Magma (New York, N.Y.) · 2026Article
- Context-specific image quality assessment for virtual histologic staining: checklist and guideline.Journal of medical imaging (Bellingham, Wash.) · 2026Article
- A novel multi-parameter MRI-based model for identification of high-risk metabolic dysfunction-associated steatohepatitis.European radiology · 2026Article
- Deep Learning Approaches for Multiple Sclerosis Detection in MRI Images.BioMed research international · 2026Article
- Motion artifacts and image quality in stroke MRI: associated factors and impact on AI and human diagnostic accuracy.European radiology · 2026Article
- The value of using deep learning to predict proliferative hepatocellular carcinoma based on multiphasic magnetic resonance imaging.Quantitative imaging in medicine and surgery · 2025Article
- SEMTWIST Quantification of Biofilm Infection in Human Chronic Wound Using Scanning Electron Microscopy and Machine Learning.Advances in wound care · 2025Article
- A fully automated, expert-perceptive image quality assessment system for whole-body [18F]FDG PET/CT.EJNMMI research · 2025Article
- An Interpretable Radiomics-Based Model Using Susceptibility-Weighted Imaging for Non-Invasive Prediction of Tertiary Lymphoid Structures in Hepatocellular Carcinoma.Journal of hepatocellular carcinoma · 2025Article
- Predicting microvascular invasion in solitary hepatocellular carcinoma: a multi-center study integrating clinical, MRI assessments, and radiomics indicators.Frontiers in oncology · 2025Article
- How subjective CT image quality assessment becomes surprisingly reliable: pairwise comparisons instead of Likert scale.European radiology · 2024Article
- Assessment of image quality and establishment of local acceptable quality dose for computed tomography based on patient effective diameter.Journal of medical imaging (Bellingham, Wash.) · 2024Article
- Deep Learning-based Approach for Brainstem and Ventricular MR Planimetry: Application in Patients with Progressive Supranuclear Palsy.Radiology. Artificial intelligence · 2024Article
- Lightweight preprocessing and template matching facilitate streamlined ischemic myocardial scar classification.Journal of medical imaging (Bellingham, Wash.) · 2024Article
- CT radiomics to differentiate neuroendocrine neoplasm from adenocarcinoma in patients with a peripheral solid pulmonary nodule: a multicenter study.Frontiers in oncology · 2024Article
- Deep learning-based high-accuracy detection for lumbar and cervical degenerative disease on T2-weighted MR images.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2023Article
- Generalizability of Machine Learning Models: Quantitative Evaluation of Three Methodological Pitfalls.Radiology. Artificial intelligence · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors.
Funding
Abstract
backgroundThe perceptual quality of magnetic resonance (MR) images influences diagnosis and may compromise the treatment. The purpose of this study was to evaluate how the image quality changes influence the interobserver variability of their assessment.
methodsFor the variability evaluation, a dataset containing distorted MRI images was prepared and then assessed by 31 experienced medical professionals (radiologists). Differences between observers were analyzed using the Fleiss' kappa. However, since the kappa evaluates the agreement among radiologists taking into account aggregated decisions, a typically employed criterion of the image quality assessment (IQA) performance was used to provide a more thorough analysis. The IQA performance of radiologists was evaluated by comparing the Spearman correlation coefficients, ρ, between individual scores with the mean opinion scores (MOS) composed of the subjective opinions of the remaining professionals.
resultsThe experiments show that there is a significant agreement among radiologists (κ=0.12; 95% confidence interval [CI]: 0.118, 0.121; P<0.001) on the quality of the assessed images. The resulted κ is strongly affected by the subjectivity of the assigned scores, separately presenting close scores. Therefore, the ρ was used to identify poor performance cases and to confirm the consistency of the majority of collected scores (ρ
conclusionsThe agreement observed among radiologists from different imaging centers confirms the subjectivity of the perception of MR images. It was shown that the image content and severity of distortions affect the IQA. Furthermore, the study highlights the importance of the psychosomatic condition of the observers and their attitude.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.