Evidence map›Paper›PMID 41924015›Full record

ArticleJAMIA open2026

Automating the segmentation, date extraction, and classification of multi-report PDFs in outside medical records using optical character recognition and generative artificial intelligence.

Shivam Damani, Benjamin Hinton, Tanner Hunt, Nicholas Lawrence, Kurt Miller, Melinda Rice, Kevin Peterson, Sarah McLaughlin, Alexander Ryu

Abstract read
In one paragraph

Article in JAMIA open, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Shivam DamaniDepartment of Medicine, Mayo Clinic, Rochester, MN, 55905, United States.
Benjamin HintonCenter for Digital Health, Mayo Clinic, Rochester, MN, 55905, United States.
Tanner HuntCenter for Digital Health, Mayo Clinic, Rochester, MN, 55905, United States.
Nicholas LawrenceCenter for Digital Health, Mayo Clinic, Rochester, MN, 55905, United States.
Kurt MillerCenter for Digital Health, Mayo Clinic, Rochester, MN, 55905, United States.
Melinda RiceCenter for Digital Health, Mayo Clinic, Rochester, MN, 55905, United States.
Kevin PetersonCenter for Digital Health, Mayo Clinic, Rochester, MN, 55905, United States.
Sarah McLaughlinDepartment of Surgery, Mayo Clinic, Jacksonville, FL, 55905, United States.
Alexander RyuDepartment of Medicine, Mayo Clinic, Rochester, MN, 55905, United States.ORCID https://orcid.org/0000-0002-0138-5112

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objectives: Patients referred for specialized care often arrive with outside medical records (OMRs) compiled into multi-report PDFs that include imaging, pathology, and clinical notes in unstructured formats. Reviewing these records is time consuming and mentally taxing, increasing the risk of delayed care, clinician frustration, and missed information affecting quality of care. This study aimed to automate the segmentation, classification, and date extraction of scanned OMRs, with a focus on records relevant to breast cancer care. Materials and Methods: We used optical character recognition (OCR) to extract machine-readable text from 1303 scanned PDF documents from 116 distinct external institutions. Gemini 1.5, a large language model (LLM), was then used to segment multi-report files into individual documents, classify them into clinically meaningful categories such as mammograms and pathology reports, and extract study dates to build diagnostic timelines. Document categories were informed by clinical workflows in a breast cancer center. Results: The system achieved an F1 score of 0.95 for segmentation, 0.96 for classification, and 0.90 for date extraction. In a pilot of 45 records reviewed by clinicians, only 2 classification errors and 1 date error were reported. Clinicians estimated that the tool reduced OMR review time by 40%, improved workflow efficiency, and increased satisfaction. Discussion: Our findings demonstrate that combining OCR with LLMs can significantly enhance the processing of unstructured medical records, reducing manual burden and supporting timely clinical decision-making. Conclusion: This study demonstrates the successful application of OCR and LLMs for organizing scanned OMRs within a specialty clinic. By automating a previously manual process, the approach supports scalable review of incoming outside records and has potential for adaptation to other clinical workflows. Future work will focus on evaluating the system across additional specialties and institutions.

Indexed as

clinical NLPdocument classificationlarge language modelsoptical character recognitionoutside medical records

Identifiers

PMID41924015
PMCPMC13036596

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.