Evidence map›Paper›PMID 42337505›Full record

ArticleBMC medical education2026

Development of vignette-based evaluation with generative artificial intelligence (VEGA) for nursing students: a pilot study.

Sujin Shin, Jaehwa Choi, Eunmin Hong, Miji Lee, Jinseon Go, Subin Yu, Minjae Lee

Abstract read
In one paragraph

Article in BMC medical education, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Sujin ShinCollege of Nursing, Ewha Womans University, Seoul, Republic of Korea.ORCID http://orcid.org/0000-0001-7981-2893
Jaehwa ChoiDepartment of Educational Leadership, Graduate School of Education and Human Development, The George Washington University, Washington, DC, USA.ORCID http://orcid.org/0000-0003-4225-9582
Eunmin HongCollege of Nursing, Wonkwang University, Iksan, Republic of Korea.ORCID http://orcid.org/0000-0003-2917-8067
Miji LeeCollege of Nursing, Catholic University of Pusan, Busan, Republic of Korea.ORCID http://orcid.org/0000-0001-7946-7006
Jinseon GoCollege of Nursing, Ewha Womans University, Seoul, Republic of Korea.ORCID http://orcid.org/0009-0002-7649-0037
Subin YuCollege of Nursing, Ewha Womans University, Seoul, Republic of Korea.ORCID http://orcid.org/0009-0001-1011-949X
Minjae LeeCollege of Nursing, Ewha Womans University, Seoul, Republic of Korea. leemj1992@gmail.com.ORCID http://orcid.org/0000-0001-7615-9593

Funding

National Research Foundation of Korea 2023R1A2C2006838
6 · The paper itself

Abstract

backgroundAdvances in AI have introduced new opportunities in nursing education. Vignette-based item sets are valuable for evaluating clinical reasoning, but are time-consuming to develop. Generative AI offers a scalable approach to streamline item generation. This study aimed to develop and evaluate a vignette-based evaluation with generative artificial intelligence (VEGA), which automatically generates vignette-based item sets, defined as short clinical scenarios followed by structured assessment items.

methodsA pilot study employed a mixed-methods design to evaluate the usability and user experiences of VEGA among nursing students. VEGA, a generative AI agent for vignette-based item set generation within the Collective AI on the Foundation AI platform, was developed based on the Analysis, Design, Development, Implementation, and Evaluation model and structured according to the NCSBN Clinical Judgment Measurement Model. Content validity was established through expert review and a preliminary survey prior to implementation. Quantitative data were collected through a post-usability survey administered to 12 undergraduate nursing students, and qualitative data were obtained through focus group interviews exploring their user experiences.

resultsIn the quantitative phase, VEGA demonstrated an overall usability score of 3.62 ± 1.04, with the highest domain score for information (4.25 ± 0.87). In the qualitative phase, focus group interviews identified four themes: individualized learning, enhancement of clinical reasoning, applicability in education and practice, and areas for improvement.

conclusionThe AI-based item generation tool was perceived by nursing students as a potential educational resource for supporting engagement with clinical reasoning, with further improvements needed in technical stability, feedback depth, and multimedia integration. Given the small sample size and pilot study design, the findings should be interpreted as preliminary.

Indexed as

Artificial IntelligenceClinical CompetenceClinical ReasoningEducational MeasurementEducation, Nursing, BaccalaureateGenerative Artificial IntelligenceStudents, NursingFemaleFocus GroupsHumansMalePilot ProjectsArtificial IntelligenceClinical Decision-MakingComputer-Assisted InstructionEducational TechnologyNursing Education

Identifiers

PMID42337505
PMCPMC13551904

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.