Evidence map›Paper›PMID 40526289›Full record

ArticleNeurosurgical review2025

The Orbital Grading system yields higher precision than the Matsushima grading system in assessing angiographic outcomes after EDAS for Moyamoya disease: an interrater reliability analysis.

Omar Alwakaa, Emmanuel Mensah, Felipe Ramirez-Velandia, Alejandro Enriquez-Marulanda, Sandeep Muram, Syed Sarmad Bukhari, Jasmeet Singh, Alfred P See, Justin H Granstein, Philipp Taussky and 1 more

Abstract read
PubMed Publisher
In one paragraph

Article in Neurosurgical review, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Omar AlwakaaNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Emmanuel MensahNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Felipe Ramirez-VelandiaNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Alejandro Enriquez-MarulandaNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Sandeep MuramNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Syed Sarmad BukhariNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Jasmeet SinghNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Alfred P SeeNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Justin H GransteinNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Philipp TausskyNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA.
Christopher S OgilvyNeurosurgical Service, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02115, USA. cogilvy@bidmc.harvard.edu.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Matsushima Grading System has been widely used to evaluate vessel ingrowth after bypass procedures for patients with Moyamoya disease (MMD). However, Matsushima is notably subjective and prone to measurement variability among clinicians. To address these limitations, the Orbital Grading System was developed as an objective approach to assess collateralization after EDAS, utilizing orbital craniometric landmarks to segment the ipsilateral skull into three distinct regions. The current study compares the interrater reliability of both scales. Six physicians, including two attending hybrid-neurovascular surgeons, one interventional neurologist, one neurointerventional radiologist and two vascular neurosurgery fellows, independently graded digital subtraction angiography (DSA) images from 37 hemispheres of MMD-patients using both the Matsushima and Orbital Grading scales. Fleiss'-kappa was used to assess inter-rater agreement for each scale, with results interpreted according to Landis-and-Koch-agreement-scale. All six raters graded 37 DSA-images using both Matsushima and the Orbital grading systems. Both scales demonstrated statistically significant inter-rater agreement (p < 0.0001). However, the Orbital Grading System produced significantly higher agreement (Kappa:0.83 [95%CI:0.74-0.93], indicating almost-perfect-agreement) compared to Matsushima grading system (Kappa:0.52 [95%CI:0.38-0.65], indicating moderate-agreement). Simple percentage agreement among all raters was 81.1% in the Orbital Grading System and 48.6% in Matsushima Grading. The Orbital Grading System demonstrates superior interrater reliability compared to the Matsushima grading, with significantly higher agreement among raters. This suggests that the Orbital Grading System is a more consistently objective tool for evaluating collateralization following EDAS. By reducing grading discrepancies between observers and enhancing generalizability, this system has the potential to optimize the management of MMD. Although our study demonstrates excellent reproducibility of the Orbital Grading System, future studies are needed to validate its accuracy in reflecting the true extent and functional significance of postoperative collateral formation.

Indexed as

Angiography, Digital SubtractionCerebral AngiographyCerebral RevascularizationMoyamoya DiseaseAdultFemaleHumansMaleMiddle AgedObserver VariationOrbitReproducibility of ResultsTreatment OutcomeAngiographyEncephaloduroarteriosynangiosis (EDAS)Matsushima grading systemMoyamoyaOrbitOrbital grading system

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.