Evidence map›Paper›PMID 33148231›Full record

ArticleBMC medical education2020

The relationship between learner engagement and teaching effectiveness: a novel assessment of student engagement in continuing medical education.

Christopher R Stephenson, Sara L Bonnes, Adam P Sawatsky, Lukas W Richards, Cathy D Schleck, Jayawant N Mandrekar, Thomas J Beckman, Christopher M Wittich

Abstract read
In one paragraph

Article in BMC medical education, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Observational
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. BINGO! Elevating Medical Physiology Tutorials Through Gamification.MedEdPORTAL : the journal of teaching and learning resources · 2025
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Christopher R StephensonDivision of General Internal Medicine, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA. stephenson.christopher@mayo.edu.ORCID http://orcid.org/0000-0001-8537-392X
Sara L BonnesDivision of General Internal Medicine, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA.
Adam P SawatskyDivision of General Internal Medicine, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA.
Lukas W RichardsDivision of General Internal Medicine, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA.
Cathy D SchleckDivision of Biomedical Statistics and Informatics, Mayo Clinic, Rochester, MN, USA.
Jayawant N MandrekarDivision of Biomedical Statistics and Informatics, Mayo Clinic, Rochester, MN, USA.
Thomas J BeckmanDivision of General Internal Medicine, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA.
Christopher M WittichDivision of General Internal Medicine, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundContinuing medical education (CME) often uses passive educational models including lectures. However, numerous studies have questioned the effectiveness of these less engaging educational strategies. Studies outside of CME suggest that engaged learning is associated with improved educational outcomes. However, measuring participants' engagement can be challenging. We developed and determined the validity evidence for a novel instrument to assess learner engagement in CME.

methodsWe conducted a cross-sectional validation study at a large, didactic-style CME conference. Content validity evidence was established through review of literature and previously published engagement scales and conceptual frameworks on engagement, along with an iterative process involving experts in the field, to develop an eight-item Learner Engagement Instrument (LEI). Response process validity was established by vetting LEI items on item clarity and perceived meaning prior to implementation, as well as using a well-developed online platform with clear instructions. Internal structure validity evidence was based on factor analysis and calculating internal consistency reliability. Relations to other variables validity evidence was determined by examining associations between LEI and previously validated CME Teaching Effectiveness (CMETE) instrument scores. Following each presentation, all participants were invited to complete the LEI and the CMETE.

results51 out of 206 participants completed the LEI and CMETE (response rate 25%) Correlations between the LEI and the CMETE overall scores were strong (r = 0.80). Internal consistency reliability for the LEI was excellent (Cronbach's alpha = 0.96). To support validity to internal structure, a factor analysis was performed and revealed a two dimensional instrument consisting of internal and external engagement domains. The internal consistency reliabilities were 0.96 for the internal engagement domain and 0.95 for the external engagement domain.

conclusionEngagement, as measured by the LEI, is strongly related to teaching effectiveness. The LEI is supported by robust validity evidence including content, response process, internal structure, and relations to other variables. Given the relationship between learner engagement and teaching effectiveness, identifying more engaging and interactive methods for teaching in CME is recommended.

Indexed as

Education, Medical, ContinuingStudentsCross-Sectional StudiesHumansLearningReproducibility of ResultsCMEEngagementTeaching effectivenessValidity

Identifiers

PMID33148231
PMCPMC7640708

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.