Evidence map›Paper›PMID 41054916›Full record

ArticleJournal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine2026

ULTRA-Metrics: Delphi-Derived Framework for Assessing Ultrasound Competency.

Steve Reid, Alberto Goffi, Ean Tsou, Emanuele Pivetta, Suean Pascoe, Jessica Solis-McCarthy, Mark Foster, Chris Gelabert, Mike Smith, Colin Bell and 11 more

Abstract read
In one paragraph

Article in Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

21 authors.

Steve ReidExecutive Office, Presuna, Coleman, Alberta, Canada.
Alberto GoffiInterdepartmental Division of Critical Care Medicine, University of Toronto, Toronto, Ontario, Canada.ORCID https://orcid.org/0000-0002-9658-3903
Ean TsouInnovation and Entrepreneurship, University of Calgary, Calgary, Alberta, Canada.
Emanuele PivettaDivision of Emergency Medicine and High Dependency Unit, Department of Medical Sciences, University of Turin, Turin, Italy.ORCID https://orcid.org/0000-0003-1446-1169
Suean PascoeExecutive Office, Zedu Ultrasound Training, Melbourne, Victoria, Australia.
Jessica Solis-McCarthyDepartment of Emergency Medicine, University of Texas Health San Antonio, San Antonio, Texas, USA.ORCID https://orcid.org/0000-0002-2767-1926
Mark FosterDepartment of Emergency Medicine, Department of Surgery Trauma Critical Care, University of Texas Health San Antonio, San Antonio, Texas, USA.
Chris GelabertDepartment of Emergency Medicine, University of Texas Health San Antonio, San Antonio, Texas, USA.
Mike SmithDepartment of Physiotherapy, College of Biomedical and Life Sciences, Cardiff University, Wales, UK.
Colin BellDepartment of Emergency Medicine, University of Calgary, Calgary, Alberta, Canada.ORCID https://orcid.org/0000-0002-6416-8537
Erica Clarke WhalenDepartment of Internal Medicine, University of Manitoba, Manitoba, Canada.
Hannah LattaDepartment of Paramedicine, Auckland University of Technology, Manukau South Campus, Auckland, New Zealand.
Janeve DesyDepartment of Medicine, University of Calgary, Calgary, Alberta, Canada.
Simon HaywardDepartment of Physiotherapy, Blackpool Teaching Hospitals NHS Foundation Trust, Blackpool, UK.
Hayley IsraelDivision of Pulmonary and Critical Care, University of New Mexico, Albuquerque, New Mexico, USA.ORCID https://orcid.org/0000-0001-8546-7803
Andrew LeamonDepartment of Emergency Medicine, Presbyterian Santa Fe Medical Center, Santa Fe, New Mexico, USA.
Marcus PeckDepartment of Anaesthesia and Intensive Care Medicine, Hampshire Hospitals NHS Foundation Trust, Winchester, UK.
Adrian WongDepartment of Critical Care, King's College Hospital, London, UK.
Tanping WongDepartment of Medicine, Weill Cornell Medicine, New York, USA.
Chris YapDepartment of Emergency, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK.ORCID https://orcid.org/0000-0001-6314-259X
Emma M L ChungDepartment of Women and Children's Health, School of Life Course and Population Sciences, Faculty of Life Sciences and Medicine, King's College London, London, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesUltrasound competency is critical in modern healthcare, yet no standardized framework currently supports ultrasound skill monitoring across diverse clinical settings and user types. Existing frameworks often lack generalizability, overemphasize exam counts, and fail to assess key skills such as interpretation, limiting ultrasound's safe and effective integration into clinical practice. The objective of this study is to develop a consensus-based, universal framework for monitoring ultrasound competency across clinical applications and disciplines.

methodsA modified Delphi process was conducted with an international panel of Point-of-Care ultrasound experts. Panelists independently evaluated framework elements categorized by competency domains (experience, skills, autonomy), skill domains (indication, acquisition, interpretation, clinical integration), metrics (eg, exam counts, entrustability, interpretation accuracy, etc.), answer sets (score-based inputs used by assessors), and score criteria (requirements for each score). Consensus thresholds were defined as strong consensus at >84%, and weak consensus at 68-84%. Two Delphi rounds were completed.

resultsNineteen experts participated across 2 Delphi rounds. Strong consensus was reached to include 3 competency domains (experience, skills, autonomy) and 4 skill domains (indication, acquisition, interpretation, and clinical integration). Optional components, including the use of acquisition skill trees and varied answer set granularity, were favored by some participants to allow ultrasound programs to tailor the framework to specific examinations, assessment scenarios, and job roles.

conclusionThe resulting modular framework provides a flexible, consensus-based approach to ultrasound competency assessment, enabling cross-program comparisons and evaluation of training methods. Validation across diverse settings is needed to support its use in global competency standards and ultrasound education expansion.

Indexed as

Clinical CompetenceConsensusDelphi TechniqueHumansUltrasonographycompetencymetricsPOCUSstandardstrainingultrasound

Identifiers

PMID41054916
PMCPMC12757764

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.