Evidence map›Paper›PMID 42202270›Full record

ArticleJMIR medical education2026

Learning Analytics of a National Entrustable Professional Activities Platform: Cross-Sectional Study of System-Level Constraints on Advanced Entrustment in Competency-Based Medical Education.

Jeng-Wen Chen, Rui-Bin Yu, Kai-Nan Lin, Yukiko Ono, Xuan-Bing Yu, Wei-Chung Hsu, Pa-Chun Wang, Li-Jen Liao, Chun-Hou Liao, Mingchih Chen

Abstract read
In one paragraph

Article in JMIR medical education, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Jeng-Wen Chen *Department of Otolaryngology-Head and Neck Surgery, Cardinal Tien Hospital and College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.ORCID 0000-0003-3635-4815
Rui-Bin Yu *Department of Otolaryngology-Head and Neck Surgery, Cardinal Tien Hospital and Fu Jen Catholic University, New Taipei City, Taiwan.ORCID 0000-0002-7138-3788
Kai-Nan Lin *Department of Otolaryngology-Head and Neck Surgery, Cardinal Tien Hospital and College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.ORCID 0009-0005-7886-5455
Yukiko OnoDepartment of Hospital Management, Graduate Institute of Business Administration, Fu Jen Catholic University, New Taipei City, Taiwan.ORCID 0009-0007-9408-7096
Xuan-Bing YuDepartment of Hospital Management, Graduate Institute of Business Administration, Fu Jen Catholic University, New Taipei City, Taiwan.ORCID 0009-0000-9812-026X
Wei-Chung HsuDepartment of Otolaryngology, Head and Neck Surgery, National Taiwan University Hospital and Children's Hospital, Taipei, Taiwan.ORCID 0000-0001-8583-8459
Pa-Chun WangDepartment of Otolaryngology, Cathay General Hospital, Taipei, Taiwan.ORCID 0000-0002-6288-9218
Li-Jen LiaoFar Eastern Memorial Hospital, New Taipei City, Taiwan.ORCID 0000-0003-0837-1597
Chun-Hou LiaoSchool of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan.ORCID 0000-0001-9414-8660
Mingchih ChenData Science Center, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.ORCID 0000-0002-8278-0033

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundCompetency-based medical education (CBME) relies on entrustable professional activities (EPAs) and Clinical Competency Committee (CCC) deliberation to support defensible decisions about trainee progression. As digital assessment platforms increasingly aggregate workplace-based assessment data across training programs, large-scale learning analytics can provide new insights into how entrustment decisions are generated and interpreted within CBME systems. However, little is known about how national assessment infrastructures influence patterns of entrustment attainment.

objectiveThis study examined national CCC summative entrustment decisions to identify system-level factors associated with attainment of expected supervision levels across residency training.

methodsWe conducted a cross-sectional analysis of nationwide CCC entrustment data derived from the Emyway digital assessment platform used by all accredited otolaryngology-head and neck surgery residency programs in Taiwan. The dataset included 3504 summative entrustment decisions across 12 EPAs for 292 residents. Observed supervision levels were compared with prespecified targets for each training year. Logistic regression models were used to identify factors associated with attainment of expected supervision levels, including training stage, EPA sequencing, CCC review cadence, and program characteristics.

resultsMedian supervision levels increased across training years but did not consistently reach expected targets in later stages. Expected entrustment targets were met in 2558 of 3504 decisions (73%). Underattainment was most pronounced in senior training years, particularly R4 and R5. In multivariable analyses, delayed EPA sequencing (adjusted odds ratio 0.75, 95% CI 0.63-0.91) and lower CCC review cadence (adjusted odds ratio 0.41, 95% CI 0.28-0.61) were independently associated with lower attainment. Program-level variability in entrustment outcomes was also observed.

conclusionsNationwide learning analytics of CCC entrustment decisions revealed a reproducible late-stage gap between expected and observed autonomy in CBME training. This pattern was associated with features of assessment system design that may be modifiable rather than trainee characteristics alone. National benchmarking of digital assessment data can therefore provide actionable insights to optimize EPA sequencing, CCC governance, and evidence generation within CBME systems.

Indexed as

Clinical CompetenceCompetency-Based EducationCross-Sectional StudiesEducational MeasurementHumansInternship and ResidencyTaiwanclinical competency committeescompetency-based medical educationdigital assessment systemsentrustable professional activitieslearning analyticsworkplace-based assessment

Identifiers

PMID42202270
PMCPMC13254506

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.