Evidence map›Paper›PMID 39378414›Full record

ArticleHepatology (Baltimore, Md.)2025

Evaluating the positive predictive value of code-based identification of cirrhosis and its complications utilizing GPT-4.

Aryana T Far, Asal Bastani, Albert Lee, Oksana Gologorskaya, Chiung-Yu Huang, Mark J Pletcher, Jennifer C Lai, Jin Ge

Abstract read
In one paragraph

Article in Hepatology (Baltimore, Md.), 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Patients who underwent TIPS face increases in hernia incarceration rates compared to patients managed with paracentesis: An analysis of prevalence and risk factors.Liver transplantation : official publication of the American Association for the Study of Liver Diseases and the International Liver Transplantation Society · 2026
    Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Article
  8. Review
  9. Article
  10. Review
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Aryana T FarDepartment of Medicine, Division of Gastroenterology and Hepatology, University of California-San Francisco, San Francisco, California, USA.ORCID 0009-0004-9664-902
Asal BastaniDepartment of Medicine, Division of Gastroenterology and Hepatology, University of California-San Francisco, San Francisco, California, USA.ORCID 0000-0002-2433-1504
Albert LeeAcademic Research Services, University of California-San Francisco, San Francisco, California, USA.ORCID 0000-0002-3821-4376
Oksana GologorskayaAcademic Research Services, University of California-San Francisco, San Francisco, California, USA.ORCID 0009-0005-3505-7300
Chiung-Yu HuangDepartment of Epidemiology and Biostatistics, University of California-San Francisco, San Francisco, California, USA.ORCID 0000-0003-2313-3562
Mark J PletcherDepartment of Epidemiology and Biostatistics, University of California-San Francisco, San Francisco, California, USA.ORCID 0000-0002-6966-1312
Jennifer C LaiDepartment of Medicine, Division of Gastroenterology and Hepatology, University of California-San Francisco, San Francisco, California, USA.ORCID 0000-0003-2092-6380
Jin GeDepartment of Medicine, Division of Gastroenterology and Hepatology, University of California-San Francisco, San Francisco, California, USA.ORCID 0000-0003-1574-1525

Funding

Clinical and Translational Science InstituteUL1TR001872 · NCATS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI COLLARD, HAROLD R, JACOBY, VANESSA · 2016 to 2025
$112.1M
UCSF Liver Core CenterP30DK026743 · NIDDK · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jennifer Y. Chen · 1986 to 2026
$30.7M
Institutional Career Development Core SupplementKL2TR001870 · NCATS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI KANAYA, ALKA M., SARKAR, URMIMALA · 2016 to 2025
$19.7M
The spectrum of cognitive impairment including Alzheimer’s Disease and Related Dementias after liver transplantationR01AG059183 · NIA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jennifer C. Lai · 2018 to 2026
$9.9M
The Impact of Frailty on Liver Transplant Outcomes in Older Adults with Hepatocellular CarcinomaK24AG080021 · NIA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jennifer C. Lai · 2023 to 2026
$755k
A pragmatic RCT to evaluate the effect of CirrhosisRx, a novel clinical decision support system, versus usual care on guideline-adherence and clinical outcomes for patients with cirrhosisK23DK139455 · NIDDK · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jin Ge · 2024 to 2026
$569k
NCATS NIH HHS KL2 TR001870NCATS NIH HHS UL1 TR001872NIA NIH HHS K24 AG080021NIA NIH HHS R01 AG059183NIDDK NIH HHS K23 DK139455NIDDK NIH HHS P30 DK026743
6 · The paper itself

Abstract

BACKGROUND AND

aimsDiagnosis code classification is a common method for cohort identification in cirrhosis research, but it is often inaccurate and augmented by labor-intensive chart review. Natural language processing using large language models (LLMs) is a potentially more accurate method. To assess LLMs' potential for cirrhosis cohort identification, we compared code-based versus LLM-based classification with chart review as a "gold standard." APPROACH AND

resultsWe extracted and conducted a limited chart review of 3788 discharge summaries of cirrhosis admissions. We engineered zero-shot prompts using a Generative Pre-trained Transformer 4 to determine whether cirrhosis and its complications were active hospitalization problems. We calculated positive predictive values (PPVs) of LLM-based classification versus limited chart review and PPVs of code-based versus LLM-based classification as a "silver standard" in all 3788 summaries. Compared to gold standard chart review, code-based classification achieved PPVs of 82.2% for identifying cirrhosis, 41.7% for HE, 72.8% for ascites, 59.8% for gastrointestinal bleeding, and 48.8% for spontaneous bacterial peritonitis. Compared to the chart review, Generative Pre-trained Transformer 4 achieved 87.8%-98.8% accuracies for identifying cirrhosis and its complications. Using LLM as a silver standard, code-based classification achieved PPVs of 79.8% for identifying cirrhosis, 53.9% for HE, 55.3% for ascites, 67.6% for gastrointestinal bleeding, and 65.5% for spontaneous bacterial peritonitis.

conclusionsLLM-based classification was highly accurate versus manual chart review in identifying cirrhosis and its complications. This allowed us to assess the performance of code-based classification at scale using LLMs as a silver standard. These results suggest LLMs could augment or replace code-based cohort classification and raise questions regarding the necessity of chart review.

Indexed as

Liver CirrhosisNatural Language ProcessingAgedAscitesFemaleGastrointestinal HemorrhageHepatic EncephalopathyHumansMaleMiddle AgedPredictive Value of TestsRetrospective Studiescirrhosiscohort identificationlarge language models (LLMs)natural language processing

Identifiers

PMID39378414
PMCPMC11975717

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.