Evidence map›Paper›PMID 35237228›Full record

ArticleFrontiers in neurology2022

Effect of Training on Visual Identification of High Frequency Oscillations-A Delphi-Style Intervention.

Aaron M Spring, Daniel J Pittman, Arsalan Rizwan, Yahya Aghakhani, Jeffrey Jirsch, Mary Connolly, Samuel Wiebe, Juan Pablo Appendino, Anita Datta, Trevor Steve and 12 more

Abstract read
In one paragraph

Article in Frontiers in neurology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

22 authors.

Aaron M SpringDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Daniel J PittmanHotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.
Arsalan RizwanSeaman Family MR Research Centre, Foothills Medical Centre, Calgary, AB, Canada.
Yahya AghakhaniDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Jeffrey JirschDepartment of Medicine, University of Alberta, Edmonton, AB, Canada.
Mary ConnollyDepartment of Pediatrics, University of British Columbia, Vancouver, BC, Canada.
Samuel WiebeDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Juan Pablo AppendinoDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Anita DattaDepartment of Pediatrics, University of British Columbia, Vancouver, BC, Canada.
Trevor SteveDepartment of Medicine, University of Alberta, Edmonton, AB, Canada.
Neelan PillayDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Manouchehr JavidanDepartment of Medicine, University of British Columbia, Vancouver, BC, Canada.
Morris ScantleburyDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Chantelle HrazdilDepartment of Medicine, University of British Columbia, Vancouver, BC, Canada.
Colin Bruce JosephsonDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Cyrus BoelmanDepartment of Pediatrics, University of British Columbia, Vancouver, BC, Canada.
Donald GrossDepartment of Medicine, University of Alberta, Edmonton, AB, Canada.
Shaily SinghDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Luis Bello-EspinosaDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.
Linda HuhDepartment of Pediatrics, University of British Columbia, Vancouver, BC, Canada.
Nathalie JettéDepartment of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY, United States.
Paolo FedericoDepartment of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveWe examined the effect of a simple Delphi-method feedback on visual identification of high frequency oscillations (HFOs) in the ripple (80-250 Hz) band, and assessed the impact of this training intervention on the interrater reliability and generalizability of HFO evaluations.

methodsWe employed a morphology detector to identify potential HFOs at two thresholds and presented them to visual reviewers to assess the probability of each epoch containing an HFO. We recruited 19 board-certified epileptologists with various levels of experience to complete a series of HFO evaluations during three sessions. A Delphi-style intervention was used to provide feedback on the performance of each reviewer relative to their peers. A delayed-intervention paradigm was used, in which reviewers received feedback either before or after the second session. ANOVAs were used to assess the effect of the intervention on the reviewers' evaluations. Generalizability theory was used to assess the interrater reliability before and after the intervention.

resultsThe intervention, regardless of when it occurred, resulted in a significant reduction in the variability between reviewers in both groups ( SIGNIFICANCE: This study shows a robust effect of a Delphi-style intervention on the interrater variability, reliability, and generalizability of HFO evaluations. The observed decreases in HFO marking discrepancies across 14 of the 15 reviewers are encouraging: they are necessarily associated with an increase in interrater reliability, and therefore with a corresponding decrease in the number of reviewers required to achieve strong generalizability. Indeed, the reliability of all reviewers following the intervention was similar to that of experienced reviewers prior to intervention. Therefore, a Delphi-style intervention could be implemented either to sufficiently train any reviewer, or to further refine the interrater reliability of experienced reviewers. In either case, a Delphi-style intervention would help facilitate the standardization of HFO evaluations and its implementation in clinical care.

Indexed as

Delphi methodepilepsyfeedbackgeneralizability theoryhigh frequency oscillations (HFO)interrater reliabilityintracranial electroencephalography (iEEG)training

Identifiers

PMID35237228
PMCPMC8884138

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.