Evidence map›Paper›PMID 31792970›Full record

ArticleEpilepsia2020

Prospective validation study of an epilepsy seizure risk system for outpatient evaluation.

Sharon Chiang, Daniel M Goldenholz, Robert Moss, Vikram R Rao, Zulfi Haneef, William H Theodore, Jonathan K Kleen, Jay Gavvala, Marina Vannucci, John M Stern

Open access · greenAbstract readValidation Study
In one paragraph

Article in Epilepsia, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
2.8field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 24 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Review
  10. Review
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 7 institutions in 1 country.

Sharon ChiangDepartment of Neurology and Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, California.ORCID 0000-0002-4548-4550
Daniel M GoldenholzDepartment of Neurology, Beth Israel Deaconess Medical Center, Boston, Massachusetts.ORCID 0000-0002-8370-2758
Robert MossSeizure Tracker TM LLC, Annandale, Virginia.
Vikram R RaoDepartment of Neurology and Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, California.ORCID 0000-0002-6389-2638
Zulfi HaneefDepartment of Neurology, Baylor College of Medicine, Houston, Texas.
William H TheodoreClinical Epilepsy Section, National Institute of Neurological Disorders and Stroke (NINDS), National Institutes of Health (NIH), Bethesda, Maryland.ORCID 0000-0002-4669-5747
Jonathan K KleenDepartment of Neurology and Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, California.ORCID 0000-0003-2622-3205
Jay GavvalaDepartment of Neurology, Baylor College of Medicine, Houston, Texas.ORCID 0000-0002-9392-6608
Marina VannucciDepartment of Statistics, Rice University, Houston, Texas.ORCID 0000-0002-7360-5321
John M SternDepartment of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, California.ORCID 0000-0002-3549-1642
University of California, San Francisco · USBaylor College of Medicine · USBeth Israel Deaconess Medical Center · USNational Institutes of Health · USRice University · USUniversity of California, Los Angeles · USVirginia Cancer Specialists · US

Funding

Physiologic And Pharmacologic Studies In EpilepsyZIANS002236 · NINDS · NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE · PI THEODORE, WILLIAM · 2009 to 2020
$14.2M
Training in Neurostatistics and NeuroepidemiologyT32NS048005 · NINDS · HARVARD UNIVERSITY (SCH OF PUBLIC HLTH) · PI ONNELA, JUKKA-PEKKA · 2004 to 2018
$3.2M
Hippocampal-cortical networks underlying memory retrieval of linguistic knowledgeK23NS110920 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI KLEEN, JONATHAN · 2019 to 2023
$1.0M
Intramural NIH HHS ZIA NS002236NINDS NIH HHS K23 NS110920NINDS NIH HHS T32 NS048005
6 · The paper itself

Abstract

objectiveWe conducted clinical testing of an automated Bayesian machine learning algorithm (Epilepsy Seizure Assessment Tool [EpiSAT]) for outpatient seizure risk assessment using seizure counting data, and validated performance against specialized epilepsy clinician experts.

methodsWe conducted a prospective longitudinal study of EpiSAT performance against 24 specialized clinician experts at three tertiary referral epilepsy centers in the United States. Accuracy, interrater reliability, and intra-rater reliability of EpiSAT for correctly identifying changes in seizure risk (improvements, worsening, or no change) were evaluated using 120 seizures from four synthetic seizure diaries (seizure risk known) and 120 seizures from four real seizure diaries (seizure risk unknown). The proportion of observed agreement between EpiSAT and clinicians was evaluated to assess compatibility of EpiSAT with clinical decision patterns by epilepsy experts.

resultsEpiSAT exhibited substantial observed agreement (75.4%) with clinicians for assessing seizure risk. The mean accuracy of epilepsy providers for correctly assessing seizure risk was 74.7%. EpiSAT accurately identified seizure risk in 87.5% of seizure diary entries, corresponding to a significant improvement of 17.4% (P = .002). Clinicians exhibited low-to-moderate interrater reliability for seizure risk assessment (Krippendorff's α = 0.46) with good intrarater reliability across a 4- to 12-week evaluation period (Scott's π = 0.89). SIGNIFICANCE: These results validate the ability of EpiSAT to yield objective clinical recommendations on seizure risk which follow decision patterns similar to those from specialized epilepsy providers, but with improved accuracy and reproducibility. This algorithm may serve as a useful clinical decision support system for quantitative analysis of clinical seizure frequency in clinical epilepsy practice.

Indexed as

AlgorithmsDecision Support Systems, ClinicalAdultBayes TheoremChildEpilepsyFemaleHumansInfantLongitudinal StudiesMachine LearningMaleOutpatientsRisk AssessmentSeizuresYoung Adultclinical decision support systeminterrater reliabilityintrarater reliabilityseizure risk

Identifiers

PMID31792970
PMCPMC6980278
OpenAlexW2992534408

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.