Evidence map›Paper›PMID 33502563›Full record

ArticleClinical neuroradiology2021

ASPECTS Interobserver Agreement of 100 Investigators from the TENSION Study.

Noel van Horn, Helge Kniep, Gabriel Broocks, Lukas Meyer, Fabian Flottmann, Matthias Bechstein, Julia Götz, Götz Thomalla, Martin Bendszus, Susanne Bonekamp and 4 more

Registry-linked trialAbstract read
In one paragraph

Article in Clinical neuroradiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03094715 (Efficacy and Safety of Thrombectomy in Stroke With Extended Lesion and Extended Time Window), which is not on this map. Cited by 32 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
32citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03094715 naterminatednot on this map

Efficacy and Safety of Thrombectomy in Stroke With Extended Lesion and Extended Time Window: a Randomized, Controlled Trial

TypeinterventionalSponsorUniversity Hospital HeidelbergRan2018 to 2023Enrolled253ConditionsStroke, Acute, Cerebral Stroke, Cerebrovascular Stroke, ApoplexyArmsThrombectomy, Best medical care
3 · Its place in the literature

Who cites it

32 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Observational
  3. Article
  4. Article
  5. Large Core Trial.AJNR. American journal of neuroradiology · 2025
    Review
  6. Observational
  7. Article
  8. Validation of the Charlotte large artery occlusion endovascular therapy outcome score using Viz.ai-derived cerebral blood volume index.Interventional neuroradiology : journal of peritherapeutic neuroradiology, surgical procedures and related neurosciences · 2025
    Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Noel van HornDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany. no.vanhorn@uke.de.ORCID http://orcid.org/0000-0001-5764-1982
Helge KniepDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Gabriel BroocksDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Lukas MeyerDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Fabian FlottmannDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Matthias BechsteinDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Julia GötzDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Götz ThomallaDepartment of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Martin BendszusDepartment of Neuroradiology, University of Heidelberg, Heidelberg, Germany.
Susanne BonekampDepartment of Neuroradiology, University of Heidelberg, Heidelberg, Germany.
Johannes Alex Rolf PfaffDepartment of Neuroradiology, University of Heidelberg, Heidelberg, Germany.
Paulo Roberto DellaniForschungszentrum Jülich, Institute of Neurosciences and Medicine, Jülich, Germany.
Jens FiehlerDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Uta HanningDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.

Funding

Horizon 2020 (European Union) 754640
6 · The paper itself

Abstract

purposeEvaluating the extent of cerebral ischemic infarction is essential for treatment decisions and assessment of possible complications in patients with acute ischemic stroke. Patients are often triaged according to image-based early signs of infarction, defined by Alberta Stroke Program Early CT Score (ASPECTS). Our aim was to evaluate interrater reliability in a large group of readers.

methodsWe retrospectively analyzed 100 investigators who independently evaluated 20 non-contrast computed tomography (NCCT) scans as part of their qualification program for the TENSION study. Test cases were chosen by four neuroradiologists who had previously scored NCCT scans with ASPECTS between 0 and 8 and high interrater agreement. Percent and interrater agreements were calculated for total ASPECTS, as well as for each ASPECTS region.

resultsPercent agreements for ASPECTS ratings was 28%, with interrater agreement of 0.13 (95% confidence interval, CI 0.09-0.16), at zero tolerance allowance and 66%, with interrater agreement of 0.32 (95% CI: 0.21-0.44), at tolerance allowance set by TENSION inclusion criteria. ASPECTS region with highest level of agreement was the insular cortex (percent agreement = 96%, interrater agreement = 0.96 (95% CI: 0.94-0.97)) and with lowest level of agreement the M3 region (percent agreement = 68%, interrater agreement = 0.39 [95% CI: 0.17-0.61]).

conclusionInterrater agreement reliability for total ASPECTS and study enrollment was relatively low but seems sufficient for practical application. Individual region analysis suggests that some are particularly difficult to evaluate, with varying levels of reliability. Potential impairment of the supraganglionic region must be examined carefully, particularly with respect to the decision whether or not to perform mechanical thrombectomy.

Indexed as

Brain IschemiaStrokeAlbertaHumansInsular CortexObserver VariationReproducibility of ResultsRetrospective StudiesAcute stroke therapyBrainEndovascular treatmentInterrater reliabilityIschemic strokeKrippendorff’s α

Identifiers

PMID33502563
PMCPMC8648648

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.