Evidence map›Paper›PMID 37670071›Full record

ArticleJournal of general internal medicine2024

Validity Evidence for the Physician Oral Language Observation Matrix as a Measure of Medical Spanish Proficiency.

Pilar Ortega, Steven E Gregorich, Leah Karliner, Javier González, Cristina Pérez-Cordón, Reniell X Iñiguez, Karen Izquierdo, Lisa C Diamond

Open access · bronzeAbstract readValidation Study
In one paragraph

Article in Journal of general internal medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
3.9field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 9 citations in OpenAlex.

  1. Observational
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 6 institutions in 1 country.

Pilar OrtegaDepartments of Medical Education and Emergency Medicine, University of Illinois College of Medicine, Chicago, IL, USA. POrtega1@uic.edu.ORCID 0000-0002-5136-1805
Steven E GregorichDivision of General Internal Medicine, Department of Medicine, University of California, San Francisco, San Francisco, CA, USA.
Leah KarlinerDivision of General Internal Medicine, Center for Aging in Diverse Communities, Multiethnic Health Equity Research Center, Department of Medicine, University of California, San Francisco, San Francisco, CA, USA.ORCID 0000-0003-2204-5114
Javier GonzálezLanguage Initiatives Program, Immigrant Health and Cancer Disparities Service, Department of Psychiatry and Behavioral Sciences, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Cristina Pérez-CordónLanguage and Communication Training Unit, United Nations Headquarters, New York, NY, USA.
Reniell X IñiguezInternal Medicine, Northwestern University Chicago, Chicago, IL, USA.
Karen IzquierdoAnesthesiology, Maimonides Medical Center, Brooklyn, NY, USA.
Lisa C DiamondHospital Medicine Service, Immigrant Health and Cancer Disparities Service, Departments of Medicine and Psychiatry and Behavioral Sciences, Memorial Sloan Kettering Cancer Center, New York, NY, USA.ORCID 0000-0002-2175-6224
Memorial Sloan Kettering Cancer Center · USUniversity of California, San Francisco · USIllinois College · USMaimonides Medical Center · USNorthwestern University · USUnited Nations · US

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
National Board of Medical Examiners Stemmler Fund Grant 2020NCI NIH HHS P30 CA008748Patient-Centered Outcomes Research Institute AD-1409-23627
6 · The paper itself

Abstract

backgroundThe lack of a standardized language assessment process for medical students and physicians communicating in a non-English language threatens healthcare quality and safety.

objectiveTo evaluate the validity of a new rating tool, the Physician Oral Language Observation Matrix (POLOM)™, in assessing medical students' oral communication with Spanish-speaking standardized patients (SPs).

designPOLOM scores were compared to measures of student medical Spanish proficiency to examine convergent validity and to measures of clinical performance to examine concurrent/criterion validity.

participantsForty-two students at two schools completed SP encounters between January 2021 and April 2022, and POLOM raters scored the videorecorded performances between January and June 2022. MAIN MEASURES: Two approaches to generating POLOM total scores were investigated: rater average and strict consensus. Convergent validity was examined via the POLOM's correlations with (1) the phone-based Clinician Cultural and Linguistic Assessment (CCLA) and (2) the self-rated Interagency Language Roundtable scale for healthcare (ILR-H). Concurrent/criterion validity was examined via correlations with (1) the Comunicación y Habilidades Interpersonales (CAI) scale, (2) a checklist completed by the SP, and (3) a faculty rating of the student's post-encounter clinical note. Pearson's correlations of r ≥ 0.5 and r ≥ 0.2 were considered evidence of convergent validity and concurrent/criterion validity, respectively. KEY

resultsBoth rater average and strict consensus POLOM scores were strongly correlated with ILR-H (r = 0.72) and CCLA (r ≥ 0.60), providing evidence of convergent validity. The POLOM was substantially correlated with the CAI (r ≥ 0.29), the SP Checklist (r = 0.32), and the faculty scoring of the student's clinical note (r ≥ 0.24), providing concurrent/criterion validity evidence.

conclusionsThe POLOM has demonstrated evidence of convergent and concurrent/criterion validity as a measure of medical students' Spanish proficiency during SP encounters. Additional research is needed to evaluate how the POLOM can be implemented with resident and practicing physicians, applied to other health professions, and adapted to other languages.

Indexed as

Physician-Patient RelationsStudents, MedicalAdultClinical CompetenceCommunication BarriersFemaleHispanic or LatinoHumansLanguageMaleMultilingualismReproducibility of ResultsYoung Adultclinical skills assessment.medical educationmedical Spanishphysician–patient communication

Identifiers

PMID37670071
PMCPMC11116337
OpenAlexW4386462083

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.