Evidence map›Paper›PMID 35882104›Full record

ArticleSeizure2022

Development of a natural language processing algorithm to extract seizure types and frequencies from the electronic health record.

Barbara M Decker, Alexandra Turco, Jian Xu, Samuel W Terman, Nikitha Kosaraju, Alisha Jamil, Kathryn A Davis, Brian Litt, Colin A Ellis, Pouya Khankhanian and 1 more

Abstract read
In one paragraph

Article in Seizure, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. [Structured Annotation and Information Extraction of Epilepsy Clinical Texts].Sichuan da xue xue bao. Yi xue ban = Journal of Sichuan University. Medical science edition · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Barbara M DeckerDepartment of Neurology, University of Pennsylvania, Philadelphia, PA, United States; Department of Neurological Sciences, University of Vermont Medical Center, Burlington, VT, United States. Electronic address: Barbara.decker@uvmhealth.org.
Alexandra TurcoDepartment of Neurology, University of Pennsylvania, Philadelphia, PA, United States.
Jian XuDepartment of Neurology, Henry Ford Health System, Detroit, MI, United States.
Samuel W TermanDepartment of Neurology, University of Michigan, Ann Arbor, MI, United States.
Nikitha KosarajuDepartment of Neurology, University of Pennsylvania, Philadelphia, PA, United States.
Alisha JamilDepartment of Neurology, University of Pennsylvania, Philadelphia, PA, United States.
Kathryn A DavisDepartment of Neurology, University of Pennsylvania, Philadelphia, PA, United States.
Brian LittDepartment of Neurology, University of Pennsylvania, Philadelphia, PA, United States.
Colin A EllisDepartment of Neurology, University of Pennsylvania, Philadelphia, PA, United States.
Pouya KhankhanianKaiser Permanente, Oakland, CA, United States.
Chloe E HillDepartment of Neurology, University of Michigan, Ann Arbor, MI, United States.

Funding

Michigan Institute for Clinical and Health Research (MICHR)UL1TR002240 · NCATS · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI LUMENG, JULIE C, MASHOUR, GEORGE ALEXANDER · 2017 to 2022
$54.9M
Institutional Career Development CoreKL2TR002241 · NCATS · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI ELLINGROD, VICKI L · 2017 to 2021
$6.9M
Ghost in the Machine: Melding Brain, Computer and BehaviorDP1NS122038 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI LITT, BRIAN · 2020 to 2024
$5.7M
Neurologic Clinical Epidemiology Training ProgramT32NS061779 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI Andrea Lauren Christman Schneider, Allison Willis · 2008 to 2026
$4.6M
Optimized Intracranial EEG Targeting in Focal Epilepsy based upon Neuroimaging ConnectomicsR01NS116504 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI DAVIS, KATHRYN ADAMIAK · 2021 to 2025
$3.3M
Remapping neurology through translation and innovationT32NS091008 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI AGUIRRE, GEOFFREY KARL, JENSEN, FRANCES E · 2015 to 2024
$3.0M
Guiding epilepsy surgery using network models and Stereo EEGR01NS125137 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI BASSETT, DANIELLE SMITH, LITT, BRIAN · 2022 to 2025
$2.8M
Polygenic risk in familial epilepsyK23NS121520 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI ELLIS, COLIN · 2021 to 2025
$1.1M
Virtual Resection to Treat EpilepsyR56NS099348 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI BASSETT, DANIELLE SMITH, LITT, BRIAN · 2021 to 2021
$552k
NCATS NIH HHS KL2 TR002241NCATS NIH HHS UL1 TR002240NINDS NIH HHS DP1 NS122038NINDS NIH HHS K23 NS121520NINDS NIH HHS R01 NS116504NINDS NIH HHS R01 NS125137NINDS NIH HHS R56 NS099348NINDS NIH HHS T32 NS061779NINDS NIH HHS T32 NS091008
6 · The paper itself

Abstract

objectiveTo develop a natural language processing (NLP) algorithm to abstract seizure types and frequencies from electronic health records (EHR).

backgroundSeizure frequency measurement is an epilepsy quality metric. Yet, abstraction of seizure frequency from the EHR is laborious. We present an NLP algorithm to extract seizure data from unstructured text of clinic notes. Algorithm performance was assessed at two epilepsy centers.

methodsWe developed a rules-based NLP algorithm to recognize terms related to seizures and frequency within the text of an outpatient encounter. Algorithm output (e.g. number of seizures of a particular type within a time interval) was compared to seizure data manually annotated by two expert reviewers ("gold standard"). The algorithm was developed from 150 clinic notes from institution #1 (development set), then tested on a separate set of 219 notes from institution #1 (internal test set) with 248 unique seizure frequency elements. The algorithm was separately applied to 100 notes from institution #2 (external test set) with 124 unique seizure frequency elements. Algorithm performance was measured by recall (sensitivity), precision (positive predictive value), and F1 score (geometric mean of precision and recall).

resultsIn the internal test set, the algorithm demonstrated 70% recall (173/248), 95% precision (173/182), and 0.82 F1 score compared to manual review. Algorithm performance in the external test set was lower with 22% recall (27/124), 73% precision (27/37), and 0.40 F1 score.

conclusionsThese results suggest NLP extraction of seizure types and frequencies is feasible, though not without challenges in generalizability for large-scale implementation.

Indexed as

EpilepsyNatural Language ProcessingAlgorithmsElectronic Health RecordsHumansSeizuresAutomated extractionElectronic health recordEpilepsyNatural language processingSeizure frequency

Identifiers

PMID35882104
PMCPMC9547963

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.