Evidence map›Paper›PMID 40395408›Full record

ArticleMedEdPORTAL : the journal of teaching and learning resources2025

Moving Beyond Simplistic Research Design in Health Professions Education: What a One-Group Pretest-Posttest Design Will Not Prove.

S Beth Bierer, Gary Beck Dallaghan, Nicole J Borges, Sam Brondfield, Cha Chi Fung, Kathryn N Huggett, Cayla R Teal, Satid Thammasitboon, Colleen Y Colbert

Abstract read
In one paragraph

Article in MedEdPORTAL : the journal of teaching and learning resources, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

S Beth BiererProfessor, Department of Medicine, and Director of Assessment and Evaluation, Cleveland Clinic Lerner College of Medicine, Case Western Reserve University School of Medicine.ORCID https://orcid.org/0000-0002-7952-8822
Gary Beck DallaghanAssistant Dean for Accreditation, Carle Illinois College of Medicine.
Nicole J BorgesEdward Tulloh Krumm Professor of Medical Education and Chair, Department of Medical Education, Geisel School of Medicine at Dartmouth.
Sam BrondfieldAssociate Professor, Department of Medicine, University of California, San Francisco, School of Medicine.
Cha Chi FungProfessor, Department of Clinical Medical Education, Vice Chair of Medical Education, and Assistant Dean for Research and Scholarship in Medical Education, Keck School of Medicine of the University of Southern California.
Kathryn N HuggettRobert Larner, MD, '42 Professor of Medical Education, Assistant Dean for Medical Education, and Director of the Teaching Academy, Robert Larner, M.D., College of Medicine at the University of Vermont.
Cayla R TealEducation Professor, Population Health, and Associate Dean for Assessment and Evaluation, Office of Medical Education, University of Kansas School of Medicine.
Satid ThammasitboonAssociate Professor, Department of Pediatrics, and Director, Center for Research, Innovation and Scholarship in Health Professions Education, Baylor College of Medicine.
Colleen Y ColbertProfessor, Department of Medicine, Cleveland Clinic Lerner College of Medicine, Case Western Reserve University School of Medicine, and Director, Office of Educator & Scholar Development, Cleveland Clinic Education Foundation.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Introduction: Educational research presents unique study design challenges. Novice researchers in health professions education (HPE) frequently misuse the one-group pretest-posttest design, highlighting the need for improved training in research design. This workshop aimed to enhance understanding of research design among novice HPE researchers, specifically addressing the inherent limitations of the one-group pretest-posttest design and offering alternative approaches. Methods: Experienced HPE researchers developed this workshop to address common misunderstandings of research design. Leaders from the AAMC Medical Education, Scholarship, Research, and Evaluation section facilitated 60-75-minute workshops conducted at the four 2024 regional meetings hosted by the AAMC Group on Educational Affairs (GEA). Workshop activities included large-group discussion, small-group case-based discussion, and critiques of research designs. Participants discussed internal validity threats and alternative research designs and scholarly approaches. Results: Approximately 120 GEA regional meeting registrants attended, with 74 (61%) completing a feedback questionnaire immediately after the workshop. Most respondents reported achieving the workshop's educational objectives, such as being better able to identify internal validity threats associated with the one-group pretest-posttest design (100%) and to discuss alternative approaches to evaluate educational innovations (100%). Additionally, >95% of respondents agreed that the workshop was well organized, interactive, and valuable in providing content they could apply to their educational scholarship. Discussion: The workshop successfully clarified misconceptions surrounding the one-group pretest-posttest design while introducing participants to more rigorous research approaches. Facilitator expertise is essential. Future iterations should consider participants' experiences to tailor content further and expand offerings about research methodologies.

Indexed as

Health OccupationsResearch DesignEducationHumansResearch PersonnelSurveys and QuestionnairesEditor's ChoiceEducational ScholarshipFaculty DevelopmentPublishing/ScholarshipResearch Design

Identifiers

PMID40395408
PMCPMC12089416

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.