ArticleJournal of graduate medical education2011
Development and preliminary evaluation of a practice-based learning and improvement tool for assessing resident competence and guiding curriculum development.
Article in Journal of graduate medical education, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT00754377 (Developing a PBLI QI Systems Impact Assessment Questionnaire), which is not on this map. Cited by 11 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Developing a PBLI QI Systems Impact Assessment Questionnaire
Who cites it
11 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- The utility of website-based quality improvement tools for health professionals: a systematic review.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2024Pooled it
- Pooled it
- The RISE Assessment: A Tool to Evaluate Competencies in Patient Safety and Quality Improvement.Journal of graduate medical education · 2025Article
- Developing a tool to measure enactment of complex quality improvement interventions in healthcare.BMJ open quality · 2023Article
- A longitudinal course pilot to improve surgical resident acquisition of quality improvement skills.PloS one · 2021Article
- The Statewide Campus System Scholarly Activity Developmental Planning Framework for Community-Based GME Leaders.Spartan medical research journal · 2018Article
- Development of a Multi-Domain Assessment Tool for Quality Improvement Projects.Journal of graduate medical education · 2017Article
- Validity and Reliability of a Tool to Assess Quality Improvement Knowledge and Skills in Pediatrics Residents.Journal of graduate medical education · 2017Article
- Integrating a Resident-Driven Longitudinal Quality Improvement Curriculum Within an Ambulatory Block Schedule.Journal of graduate medical education · 2016Article
- Use of the Quality Improvement (QI) Knowledge Application Tool in Assessing Pediatric Resident QI Education.Journal of graduate medical education · 2014Article
- Pilot study evaluating a practice-based learning and improvement curriculum focusing on the development of system-level quality improvement skills.Journal of graduate medical education · 2011Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundAlthough practice-based learning and improvement (PBLI) is now recognized as a fundamental and necessary skill set, we are still in need of tools that yield specific information about gaps in knowledge and application to help nurture the development of quality improvement (QI) skills in physicians in a proficient and proactive manner. We developed a questionnaire and coding system as an assessment tool to evaluate and provide feedback regarding PBLI self-efficacy, knowledge, and application skills for residency programs and related professional requirements.
methodsFive nationally recognized QI experts/leaders reviewed and completed our questionnaire. Through an iterative process, a coding system based on identifying key variables needed for ideal responses was developed to score project proposals. The coding system comprised 14 variables related to the QI projects, and an additional 30 variables related to the core knowledge concepts related to PBLI. A total of 86 residents completed the questionnaire, and 2 raters coded their open-ended responses. Interrater reliability was assessed by percentage agreement and Cohen κ for individual variables and Lin concordance correlation for total scores for knowledge and application. Discriminative validity (t test to compare known groups) and coefficient of reproducibility as an indicator of construct validity (item difficulty hierarchy) were also assessed.
resultsInterrater reliability estimates were good (percentage of agreements, above 90%; κ, above 0.4 for most variables; concordances for total scores were R = .88 for knowledge and R = .98 for application).
conclusionDespite the residents' limited range of experiences in the group with prior PBLI exposure, our tool met our goal of differentiating between the 2 groups in our preliminary analyses. Correcting for chance agreement identified some variables that are potentially problematic. Although additional evaluation is needed, our tool may prove helpful and provide detailed information about trainees' progress and the curriculum.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.