Evidence map›Paper›PMID 40601962›Full record

ArticleJournal of clinical neurophysiology : official publication of the American Electroencephalographic Society2026

Inter-Rater Reliability of EEG-Based Encephalopathy Grading.

Ryan A Tesh, Anika Zahoor, Jayme Banks, Kaileigh Gallagher, Christine A Eckhardt, Haoqi Sun, Ioannis Karakis, Roohi Katyal, Jonathan Williams, Chetan Nayak and 13 more

Abstract read
In one paragraph

Article in Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

23 authors.

Ryan A TeshDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.ORCID 0000-0002-6154-6248
Anika ZahoorDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.
Jayme BanksDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.
Kaileigh GallagherDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.
Christine A EckhardtDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, U.S.A.
Haoqi SunDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.
Ioannis KarakisDepartment of Neurology, Emory University School of Medicine, Atlanta, Georgia, U.S.A.
Roohi KatyalDepartment of Neurology, Ochsner Louisiana State University Health Shreveport (LSUHS), Shreveport, Louisiana, U.S.A.
Jonathan WilliamsDepartment of Neurology, Washington University School of Medicine in St. Louis, St. Louis, Missouri, U.S.A.
Chetan NayakDepartment of Neurology, Washington University School of Medicine in St. Louis, St. Louis, Missouri, U.S.A.
Aline HerlopianDepartment of Neurology, Yale University School of Medicine, New Haven, Connecticut, U.S.A.
Marcus C NgDepartment of Neurology, University of Manitoba, Winnipeg, MB, Canada.
Adam S GreenblattDepartment of Neurology, Washington University School of Medicine in St. Louis, St. Louis, Missouri, U.S.A.
Emma MeyersDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, U.S.A.
Mike WestmeijerDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.
Daniel S HarrisonDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, U.S.A.
Wolfgang GanglbergerDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.
Galina GheihmanDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, U.S.A.
Tracey FanDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, U.S.A.
Aaron F StruckDepartment of Neurology, University of Wisconsin School of Medicine, William S. Middleton Veterans Memorial Hospital, Madison, Wisconsin, U.S.A. ; and.
Irfan S SheikhDepartment of Neurology, University of Texas Southwestern Medical Center, Dallas, Texas, U.S.A.
Fábio A NascimentoDepartment of Neurology, Washington University School of Medicine in St. Louis, St. Louis, Missouri, U.S.A.
M Brandon WestoverDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, U.S.A.ORCID 0000-0003-4803-312

Funding

Late-onset Unexplained Epilepsy as a Risk Factor for DementiaR01NS130119 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI Alice D Lam · 2023 to 2026
$8.7M
Data-Driven Sleep Biomarkers of Brain Health, Heart Health, and MortalityR01HL161253 · NHLBI · BETH ISRAEL DEACONESS MEDICAL CENTER · PI CLIFFORD, GARI DAVID, MIGNOT, EMMANUEL J · 2022 to 2025
$8.3M
Comparative Safety of Seizure Prophylaxis within the Medicare ProgramR01AG073410 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI Lidia Maria Veras Rocha de Moura · 2021 to 2026
$4.1M
Low Neurophysiologic Resistance to Anesthetics as a Marker of Preclinical/Prodromal Alzheimer's Disease and Neurovascular Pathology, Delirium risk and InattentionR01AG073598 · NIA · STANFORD UNIVERSITY · PI Miles Berger · 2022 to 2026
$3.8M
Integrative Motor Activity Biomarker for the Risk of Alzheimer's RiskRF1AG064312 · NIA · BRIGHAM AND WOMEN'S HOSPITAL · PI HU, KUN · 2019 to 2019
$3.6M
Investigation of Sleep in the Intensive Care Unit (ICU-SLEEP)R01NS102190 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI WESTOVER, MICHAEL BRANDON · 2018 to 2022
$3.2M
Prospective Validation of Neurophysiologic Outcome Prediction in Acute Brain InjuryR01NS126282 · NINDS · BETH ISRAEL DEACONESS MEDICAL CENTER · PI Aaron F Struck, Michael Brandon Westover · 2023 to 2026
$2.9M
Big Data and Deep Learning for the Interictal-Ictal-Injury ContiuumR01NS107291 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI WESTOVER, MICHAEL BRANDON · 2018 to 2022
$2.8M
Establishing a Brain Health Index from the Sleep ElectroencephalogramRF1NS120947 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI CASH, SYDNEY S, THOMAS, ROBERT JOSEPH · 2021 to 2021
$2.4M
Comparative Effectiveness of EEG-Guided Anti-Seizure Treatment in Acute Brain InjuryR01NS131347 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI Sahar F Zafar · 2024 to 2026
$1.9M
Establishing a Brain Health IndexR01NS120947 · NINDS · BETH ISRAEL DEACONESS MEDICAL CENTER · PI CASH, SYDNEY S, THOMAS, ROBERT JOSEPH · 2024 to 2025
$1.6M
NHLBI NIH HHS R01 HL161253NIA NIH HHS R01 AG073410NIA NIH HHS R01 AG073598NIA NIH HHS RF1 AG064312NINDS NIH HHS R01 NS102190NINDS NIH HHS R01 NS107291NINDS NIH HHS R01 NS120947NINDS NIH HHS R01 NS126282NINDS NIH HHS R01 NS130119NINDS NIH HHS R01 NS131347NINDS NIH HHS RF1 NS120947
6 · The paper itself

Abstract

purposeVisual EEG Confusion Assessment Method-Severity (VE-CAM-S) quantifies encephalopathy severity based on electroencephalography features. This study evaluated inter-rater reliability among experts using the VE-CAM-S scale.

methodsNine experts from six institutions independently reviewed 32 15-second electroencephalography samples in an online test, assessing 29 features (16 in the VE-CAM-S and 13 additional, or "VE-CAM-S+"). A consensus of three experts served as the gold standard. Performance was measured by the median Matthews correlation coefficient between expert and gold-standard VE-CAM-S+ scores, along with average sensitivity and specificity. Qualitative analysis identified common feature-recognition errors affecting scores.

resultsExperts achieved a median Matthews correlation coefficient of 0.82 [95% CI: 0.74-0.99]. Specificity exceeded 90% for most features except background β (87%) and generalized delta (71%). Sensitivity was ≥65% except for burst suppression with epileptiform activity (61%), extreme delta brush (EDB; 61%), posterior dominant rhythm (50%), background α (59%) and β (42%). Common errors included missing subtle findings, confusing features, and misidentifying extreme delta brush.

conclusionsThis pilot study offers some initial support for the reliability of VE-CAM-S+ scoring. The largest errors occurred when experts missed or falsely identified features with higher weight in the VE-CAM-S. Encephalopathy grading through VE-CAM-S may be improved by breaking high-stakes features into smaller parts, creating a "cheat sheet" with scored examples, and designing teaching materials.

Indexed as

Brain DiseasesElectroencephalographySeverity of Illness IndexAdultFemaleHumansMaleObserver VariationPilot ProjectsReproducibility of ResultsSensitivity and SpecificityCritical careElectroencephalography (EEG)EncephalopathyPilot studyReliability (inter-rater reliability, IRR)Teaching

Identifiers

PMID40601962
PMCPMC12335890

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.