Evidence map›Paper›PMID 37139206›Full record

ArticleJournal of graduate medical education2023

ENTRUST: A Serious Game-Based Virtual Patient Platform to Assess Entrustable Professional Activities in Graduate Medical Education.

Dana T Lin, Edward F Melcer, Oleksandra Keehl, Hyrum Eddington, Amber W Trickey, Jason Tsai, Fatyma Camacho, Sylvia Bereknyei Merrell, James Korndorffer, Cara A Liebert

Open access · bronzeAbstract read
In one paragraph

Article in Journal of graduate medical education, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
2.9field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it, 10 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. What Matters to Patients: Community-Engaged Design for Healthcare-Related Serious Games.Proceedings of the ... European conference on games based learning. European Conference on Games Based Learning, author · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 2 institutions in 1 country.

Dana T Linis Clinical Associate Professor, Department of Surgery, Stanford University School of Medicine.ORCID https://orcid.org/0000-0001-8470-2189
Edward F Melceris Assistant Professor and Director of the Alternative Learning Technologies and Games (ALT Games) Lab, Baskin School of Engineering, University of California, Santa Cruz.ORCID https://orcid.org/0000-0003-1760-5279
Oleksandra Keehlis a PhD Student, Baskin School of Engineering, University of California, Santa Cruz.ORCID https://orcid.org/0000-0002-4411-1912
Hyrum Eddingtonis Data Manager and Data Analyst, Stanford-Surgery Policy Improvement Research and Education Center.ORCID https://orcid.org/0000-0003-4508-073X
Amber W Trickeyis Senior Biostatistician, Stanford-Surgery Policy Improvement Research and Education Center.ORCID https://orcid.org/0000-0001-9993-3860
Jason Tsaiis a Master's Student, Baskin School of Engineering, University of California, Santa Cruz.
Fatyma Camachois a Master's Student, Baskin School of Engineering, University of California, Santa Cruz.
Sylvia Bereknyei Merrellis a Research Scholar, Department of Pediatrics, Stanford University School of Medicine.ORCID https://orcid.org/0000-0002-5525-0379
James Korndorfferis Vice Chair of Education and Associate Professor of Surgery, Department of Surgery, Stanford University School of Medicine.ORCID https://orcid.org/0000-0002-0508-6339
Cara A Liebertis Clinical Assistant Professor, Department of Surgery, Stanford University School of Medicine.ORCID https://orcid.org/0000-0002-5848-9895
Stanford University · USUniversity of California, Santa Cruz · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: As entrustable professional activities (EPAs) are implemented in graduate medical education, there is a great need for tools to efficiently and objectively evaluate clinical competence. Readiness for entrustment in surgery requires not only assessment of technical ability, but also the critical skill of clinical decision-making. Objective: We report the development of ENTRUST, a serious game-based, virtual patient case creation and simulation platform to assess trainees' decision-making competence. A case scenario and corresponding scoring algorithm for the Inguinal Hernia EPA was iteratively developed and aligned with the description and essential functions outlined by the American Board of Surgery. In this study we report preliminary feasibility data and validity evidence. Methods: In January 2021, the case scenario was deployed and piloted on ENTRUST with 19 participants of varying surgical expertise levels to demonstrate proof of concept and initial validity evidence. Total score, preoperative sub-score, and intraoperative sub-score were analyzed by training level and years of medical experience using Spearman rank correlations. Participants completed a Likert scale user acceptance survey (1=strongly agree to 7=strongly disagree). Results: Median total score and intraoperative mode sub-score were higher with each progressive level of training (rho=0.79, Conclusions: Our study demonstrates feasibility and early validity evidence for ENTRUST as an assessment platform for clinical decision-making.

Indexed as

Internship and ResidencyClinical CompetenceClinical Decision-MakingCompetency-Based EducationEducation, Medical, GraduateHumans

Identifiers

PMID37139206
PMCPMC10150817
OpenAlexW4366198931

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.