Evidence map›Paper›PMID 39749476›Full record

ArticleCirculation. Cardiovascular quality and outcomes2025

Evaluation of Peer Review of Percutaneous Coronary Intervention Operator Performance.

Jacob A Doll, Annika L Hebbe, Carol E Simons, Elliot J Stein, Stephan Eisenbarth, Stephen W Waldo, Sunil V Rao, David H Au

Abstract readMulticenter Study
In one paragraph

Article in Circulation. Cardiovascular quality and outcomes, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors.

Jacob A DollVA Puget Sound Health Care System, Seattle, WA (J.A.D., C.E.S.).ORCID 0000-0002-1459-0262
Annika L HebbeCART Program, Office of Quality and Patient Safety, Veterans Health Administration, Washington, DC (J.A.D., A.L.H., S.E., S.W.W.).ORCID 0000-0001-9840-3358
Carol E SimonsVA Puget Sound Health Care System, Seattle, WA (J.A.D., C.E.S.).ORCID 0000-0002-2400-575X
Elliot J SteinDivision of Cardiology, Department of Medicine, University of Washington, Seattle (J.A.D., E.J.S., D.H.A.).
Stephan EisenbarthCART Program, Office of Quality and Patient Safety, Veterans Health Administration, Washington, DC (J.A.D., A.L.H., S.E., S.W.W.).
Stephen W WaldoCART Program, Office of Quality and Patient Safety, Veterans Health Administration, Washington, DC (J.A.D., A.L.H., S.E., S.W.W.).ORCID 0000-0003-0678-4873
Sunil V RaoDivision of Cardiology, Department of Medicine, New York University Langone Health (S.V.R.).ORCID 0000-0003-2914-0894
David H AuDivision of Cardiology, Department of Medicine, University of Washington, Seattle (J.A.D., E.J.S., D.H.A.).

Funding

HSRD VA IK2 HX002590
6 · The paper itself

Abstract

backgroundCase-based peer review of percutaneous coronary intervention (PCI) is used by many hospitals for quality improvement and to make decisions regarding physician competency. However, there are no studies testing the reliability or validity of peer review for PCI performance evaluation.

methodsWe recruited interventional cardiologists from 12 Veterans Affairs Health System facilities throughout the United States to provide PCI cases for review. Ten reviewers performed blinded reviews such that each case was reviewed twice. Cases were rated on a scale of 1 to 5 (with 5 being the best) for 6 care domains (Appropriateness, Lesion Suitability, Strategy, Technical Performance, Outcome, and Documentation) with a summary performance score calculated as the average of all domains. Separately, reviewers determined whether the standard of care was met. Interobserver reliability of the summary performance score was calculated using interclass correlation coefficient. We examined procedural complications and 30-day mortality and major adverse cardiac events for all PCIs performed by these operators from 2019 to 2022 when stratified in tertiles by summary performance score.

resultsOf the 65 cases provided by 13 operators, the mean summary performance score was 3.90 (SD=0.78) out of 5. The interclass correlation coefficient was 0.53, indicating moderate interobserver reliability. For 19 cases (29.2%), 1 reviewer indicated that the performance did not meet the standard of care; however, the second reviewer disagreed in all these cases. Average performance scores ranged from 3.35 to 4.38. Among the 3390 PCIs performed by reviewed cardiologists from 2019 to 2022, the lowest-rated tertile had higher rates of complications (2.9% versus 1.8%,

conclusionsCase-based peer review identifies variation in physician performance that is correlated with PCI outcomes. However, reviewer disagreements about the standard of care raise concerns about the use of peer review for high-stakes assessments of physician competency.

Indexed as

CardiologistsClinical CompetenceOutcome and Process Assessment, Health CarePeer ReviewPeer Review, Health CarePercutaneous Coronary InterventionProcess Assessment, Health CareQuality ImprovementQuality Indicators, Health CareAgedFemaleHumansMaleMiddle AgedObserver VariationReproducibility of Resultscredentialingpeer reviewpercutaneous coronary interventionquality improvementstandard of care

Identifiers

PMID39749476
PMCPMC11745740

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.