Evidence map›Paper›PMID 25024769›Full record

ArticleApplied clinical informatics2014

Development and validation of a computer-based algorithm to identify foreign-born patients with HIV infection from the electronic medical record.

J Levison, V Triant, E Losina, K Keefe, K Freedberg, S Regan

Open access · bronzeAbstract readValidation Study
In one paragraph

Article in Applied clinical informatics, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
0.7field-weighted citation impact, top 29% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 15 citations in OpenAlex.

  1. Article
  2. Automated HIV Case Identification from the MIMIC-IV Database.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability.Journal of the American Medical Informatics Association : JAMIA · 2016
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 3 institutions in 1 country.

J LevisonMassachusetts General Hospital, Division of Infectious Diseases , Boston, Massachusetts, United States ; Massachusetts General Hospital, Division of General Internal Medicine , Boston, Massachusetts, United States ; Massachusetts General Hospital, Medical Practice Evaluation Center , Boston, Massachusetts, United States ; Brigham and Women's Hospital, Division of Infectious Diseases , Boston, Massachusetts, United States ; Harvard Medical School , Boston, Massachusetts, United States.
V TriantMassachusetts General Hospital, Division of Infectious Diseases , Boston, Massachusetts, United States ; Massachusetts General Hospital, Division of General Internal Medicine , Boston, Massachusetts, United States ; Massachusetts General Hospital, Medical Practice Evaluation Center , Boston, Massachusetts, United States ; Harvard Medical School , Boston, Massachusetts, United States.
E LosinaMassachusetts General Hospital, Division of General Internal Medicine , Boston, Massachusetts, United States ; Massachusetts General Hospital, Medical Practice Evaluation Center , Boston, Massachusetts, United States ; Harvard Medical School , Boston, Massachusetts, United States ; Boston University School of Public Health, Departments of Biostatistics and Epidemiology , Boston, Massachusetts, United States ; Harvard University Center for AIDS Research, Harvard University , Boston, Massachusetts, Unites States.
K KeefeMassachusetts General Hospital, Division of General Internal Medicine , Boston, Massachusetts, United States ; Massachusetts General Hospital, Medical Practice Evaluation Center , Boston, Massachusetts, United States ; Harvard Medical School , Boston, Massachusetts, United States.
K FreedbergMassachusetts General Hospital, Division of Infectious Diseases , Boston, Massachusetts, United States ; Massachusetts General Hospital, Division of General Internal Medicine , Boston, Massachusetts, United States ; Massachusetts General Hospital, Medical Practice Evaluation Center , Boston, Massachusetts, United States ; Harvard Medical School , Boston, Massachusetts, United States ; Boston University School of Public Health, Departments of Biostatistics and Epidemiology , Boston, Massachusetts, United States ; Harvard University Center for AIDS Research, Harvard University , Boston, Massachusetts, Unites States.
S ReganMassachusetts General Hospital, Division of General Internal Medicine , Boston, Massachusetts, United States ; Massachusetts General Hospital, Medical Practice Evaluation Center , Boston, Massachusetts, United States ; Harvard Medical School , Boston, Massachusetts, United States.
Harvard University Press · USBoston University · USBrigham and Women's Hospital · US

Funding

The impact of HIV viral diversity and cellular immunity on HIV pathogenesisP30AI060354 · NIAID · HARVARD UNIVERSITY (MEDICAL SCHOOL) · PI Daniel Lingwood · 2004 to 2026
$94.4M
Addressing Barriers to Retention in HIV Care for Hispanic ImmigrantsK23MH100978 · NIMH · MASSACHUSETTS GENERAL HOSPITAL · PI LEVISON, JULIE · 2014 to 2018
$960k
Incidence and Predictors of Myocardial Infarction Among HIV-Infected PatientsK01AI073109 · NIAID · MASSACHUSETTS GENERAL HOSPITAL · PI TRIANT, VIRGINIA ATHENA · 2008 to 2012
$687k
NIAID NIH HHS K01 AI073109NIAID NIH HHS P30 AI060354NIMH NIH HHS K23 MH100978
6 · The paper itself

Abstract

objectiveTo develop and validate an efficient and accurate method to identify foreign-born patients from a large patient data registry in order to facilitate population-based health outcomes research.

methodsWe developed a three-stage algorithm for classifying foreign-born status in HIV-infected patients receiving care in a large US healthcare system (January 1, 2001-March 31, 2012) (n = 9,114). In stage 1, we classified those coded as non-English language speaking as foreign-born. In stage 2, we searched free text electronic medical record (EMR) notes of remaining patients for keywords associated with place of birth and language spoken. Patients without keywords were classified as US-born. In stage 3, we retrieved and reviewed a 50-character text window around the keyword (i.e. token) for the remaining patients. To validate the algorithm, we performed a chart review and asked all HIV physicians (n = 37) to classify their patients (n = 957).We calculated algorithm sensitivity and specificity.

resultsWe excluded 160/957 because physicians indicated the patient was not HIV-infected (n = 54), "not my patient" (n = 103), or had unknown place of birth (n = 3), leaving 797 for analysis. In stage 1, providers agreed that 71/95 foreign language speakers were foreign-born. Most disagreements (23/24) involved patients born in Puerto Rico. In stage 2, 49/50 patients without keywords were classified as US-born by chart review. In stage 3, token review correctly classified 55/60 patients (92%), with 93% (CI: 84.4, 100%) sensitivity and 90% (CI: 74.3, 100%) specificity compared with full chart review. After application of the three-stage algorithm, 2,102/9,114 (23%) patients were classified as foreign-born. When compared against physician response, estimated sensitivity of the algorithm was 94% (CI: 90.9, 97.2%) and specificity 92% (CI: 89.7, 94.1%), with 92% correctly classified.

conclusionA computer-based algorithm classified foreign-born status in a large HIV-infected cohort efficiently and accurately. This approach can be used to improve EMR-based outcomes research.

Indexed as

AlgorithmsElectronic Health RecordsData MiningDelivery of Health CareEmigrants and ImmigrantsHIV InfectionsHumansLanguageMedical InformaticsReference StandardsRegistriesclassificationelectronic medical recordForeign-bornHIVimmigrant health

Identifiers

PMID25024769
PMCPMC4081756
OpenAlexW2089274188

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.