Evidence map›Paper›PMID 39359314›Full record

ArticleNeurology. Education2023

Education Research: Quality and Validity Evidence for a National In-Training Examination for Epilepsy Fellows.

Jeremy Moeller, Ernesto Gonzalez-Giraldo, France W Fung, Emily L Johnson, Ammar Kheder, Jane MacLean, Emily L McGinnis, Wolfgang G Muhlhofer, Joel M Oster, Sarah Schmitt and 6 more

Abstract read
In one paragraph

Article in Neurology. Education, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Missing Full Disclosures.Neurology. Education · 2025
    Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Jeremy MoellerFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Ernesto Gonzalez-GiraldoFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.ORCID https://orcid.org/0000-0002-6723-9775
France W FungFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Emily L JohnsonFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Ammar KhederFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Jane MacLeanFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Emily L McGinnisFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.ORCID https://orcid.org/0009-0006-0265-1263
Wolfgang G MuhlhoferFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.ORCID https://orcid.org/0000-0002-3246-6070
Joel M OsterFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.ORCID https://orcid.org/0000-0002-1895-4326
Sarah SchmittFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
P Emanuela VoinescuFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.ORCID https://orcid.org/0000-0001-5216-2018
Lily C Wong-KisielFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Kandice J KiddFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Amy KephartFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.
Fred A LadoFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.ORCID https://orcid.org/0000-0003-3648-4812
Sudha Kilaru KesslerFrom the Department of Neurology (J. Moeller), Yale School of Medicine, New Haven, CT; Departments of Neurology and Pediatrics (E.G.-G.), University of California, San Francisco; Departments of Neurology and Pediatrics (F.W.F., S.K.K.), Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia; Department of Neurology (E.L.J.), Johns Hopkins School of Medicine, Baltimore, MD; Department of Neurology and Pediatric Institute (A. Kheder), Emory University School of Medicine, Atlanta, GA; Department of Pediatric Neurology (J. MacLean), Sutter Medical Foundation, Mountain View, CA; Neurology Department (E.L.M.), Kaiser Permanente Los Angeles Medical Center, CA; University of Washington Regional Epilepsy Center (W.G.M.), University of Washington, Seattle; Department of Neurology (J.M.O.), Tufts University, Boston, MA; Department of Neurology (S.S.), Medical University of South Carolina, Charleston; Division of Epilepsy (P.E.V.), Department of Neurology, Brigham and Womens Hospital, Harvard Medical School, Boston, MA; Department of Neurology (L.C.W.-K.), Mayo Clinic College of Medicine, Rochester, MN; American Epilepsy Society (K.J.K., A. Kephart), Chicago, IL; and Department of Neurology (F.A.L.), Zucker School of Medicine at Hofstra-Northwell, Hempstead, NY.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background and Objectives: Epilepsy education has been transformed over the past 2 decades, leading to a need for structured formative assessment tools. The American Epilepsy Society developed the Epilepsy Fellowship In-Training Examination (EpiFITE) to provide high-quality formative assessment for fellows, to stimulate program improvement, and to guide future learning and teaching. The aim of this study was to explore validity evidence for the EpiFITE in meeting these goals. Methods: Validity evidence was sought from multiple sources. The content of the examination was linked to the American Board of Psychiatry and Neurology blueprint for initial certification in epilepsy, and items were developed by trained experts. Internal structure was studied using internal consistency and item analysis. Surveys of fellows and fellowship directors focused on the examination experience (response process) and how results influenced fellow assessment, future learning, and program improvement (relationship to other variables and consequences). Results: The EpiFITE was first administered in 2020, with 172 examinees from 67 programs. By 2022 (year 3), the EpiFITE was completed by 195 epilepsy fellows from 77 programs. The overall mean score of the examination was stable from year to year, and the committee predicted the difficulty of individual items with a high degree of accuracy. The examination had high internal consistency (Cronbach α 0.76-0.81). The median item discrimination index ranged from 0.17 in 2020 to 0.21 in 2022. Discrimination indices were lower (mean ≤0.10) for items that were either very easy or very difficult and significantly higher (mean >0.20) for other items. Program directors and epilepsy fellows agreed the examination questions were appropriate and agreed that the EpiFITE helped them identify areas for self-directed learning. Program directors also found the examination helpful in identifying areas of strength and areas for improvement within their programs. Discussion: There are several sources of evidence of the quality and validity of the EpiFITE. By exploring this validity evidence, we have identified several best practices in the development and evaluation of a subspecialty examination, and this experience could be helpful for developers of in-training examinations in other subspecialties.

Identifiers

PMID39359314
PMCPMC11419306

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.