ArticleNeuroradiology2022
Inter-rater reliability for assessing intracranial collaterals in patients with acute ischemic stroke: comparing 29 raters and an artificial intelligence-based software.
Article in Neuroradiology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
12 citing papers in PubMed.
- Cerebrovascular CTA radiomics for objective collateral grading in acute ischemic stroke.European radiology experimental · 2026Article
- Unfavorable Perfusion Collateral Impairment Score Is Associated with Higher Odds of Poor Outcomes in Large Vessel Occlusion Stroke.Stroke (Hoboken, N.J.) · 2025Article
- Automatic collateral quantification in acute ischemic stroke using UFrontiers in neurology · 2025Article
- Asymptotic Confidence Interval, Sample Size Formulas and Comparison Test for the Agreement Intra-Class Correlation Coefficient in Inter-Rater Reliability Studies.Statistics in medicine · 2024Article
- Clinical and Imaging Features Associated With Fast Infarct Growth During Interhospital Transfers of Patients With Large Vessel Occlusions.Neurology · 2024Article
- Pretreatment CTP Collateral Parameters Predict Good Outcomes in Successfully Recanalized Middle Cerebral Artery Distal Medium Vessel Occlusions.Clinical neuroradiology · 2024Article
- Radiomics-Based Prediction of Collateral Status from CT Angiography of Patients Following a Large Vessel Occlusion Stroke.Diagnostics (Basel, Switzerland) · 2024Article
- Inter-Rater Reliability of Collateral Status Assessment Based on CT Angiography: A Retrospective Study of Middle Cerebral Artery Ischaemic Stroke.Journal of clinical medicine · 2023Article
- Pivotal role of multiphase computed tomography angiography for collateral assessment in patients with acute ischemic stroke.La Radiologia medica · 2023Review
- Can a chest HRCT-based crash course on COVID-19 cases make inexperienced thoracic radiologists readily available to face the next pandemic?Clinical imaging · 2023Article
- Time dependency of automated collateral scores in computed tomography angiography and computed tomography perfusion images in patients with intracranial arterial occlusion.Neuroradiology · 2023Article
- Multilesion Segmentations in Patients with Intracerebral Hemorrhage: Reliability of ICH, IVH and PHE Masks.Tomography (Ann Arbor, Mich.) · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
11 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
purposeOutcome of endovascular treatment in acute ischemic stroke patients is depending on the collateral circulation maintaining blood flow to the ischemic territory. We evaluated the inter-rater reliability and accuracy of raters and an automated algorithm for assessing the collateral score (CS, range: 0-3) in acute ischemic stroke patients.
methodsBaseline CTA scans with an intracranial anterior occlusion from the MR CLEAN study (n=500) were used. For each core lab CS, ten CTA scans with sufficient quality were randomly selected. After a training session in collateral scoring, all selected CTA scans were individually evaluated for a visual CS by three groups: 7 radiologists, 13 junior and 9 senior radiology residents. Two additional radiologists scored CS to be used as reference, with a third providing a CS to produce a 2 out of 3 consensus CS in case of disagreement. An automated algorithm was also used to compute CS. Inter-rater agreement was reported with intraclass correlation coefficient (ICC). Accuracy of visual and automated CS were calculated.
results39 CTA scans were assessed (1 corrupt CTA-scan excluded). All groups showed a moderate ICC (0.689-0.780) in comparison to the reference standard. Overall human accuracy was 65± 7% and increased to 88± 5% for dichotomized CS (0-1, 2-3). Automated CS accuracy was 62%, and 90% for dichotomized CS. No significant difference in accuracy was found between groups with different levels of expertise.
conclusionAfter training, inter-rater reliability in collateral scoring was not influenced by experience. Automated CS performs similar to residents and radiologists in determining a collateral score.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.