Evidence map›Paper›PMID 39149851›Full record

ArticleJMIR medical informatics2024

Evaluation of AI-Driven LabTest Checker for Diagnostic Accuracy and Safety: Prospective Cohort Study.

Dawid Szumilas, Anna Ochmann, Katarzyna Zięba, Bartłomiej Bartoszewicz, Anna Kubrak, Sebastian Makuch, Siddarth Agrawal, Grzegorz Mazur, Jerzy Chudek

Abstract read
In one paragraph

Article in JMIR medical informatics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. ChatGPT in precision medicine.APL bioengineering · 2026
    Review
  2. Review
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Dawid SzumilasDepartment of Internal Medicine and Oncological Chemotherapy, Medical University of Silesia, Reymonta St. 8, Katowice, 40-027, Poland, +48 32 2591 202.ORCID http://orcid.org/0000-0002-6060-2279
Anna OchmannDepartment of Internal Medicine and Oncological Chemotherapy, Medical University of Silesia, Reymonta St. 8, Katowice, 40-027, Poland, +48 32 2591 202.ORCID http://orcid.org/0000-0002-2891-3202
Katarzyna ZiębaDepartment of Internal Medicine and Oncological Chemotherapy, Medical University of Silesia, Reymonta St. 8, Katowice, 40-027, Poland, +48 32 2591 202.ORCID http://orcid.org/0009-0002-3053-5340
Bartłomiej BartoszewiczLabplus R&D, Wroclaw, Poland.ORCID http://orcid.org/0009-0001-5507-1143
Anna KubrakLabplus R&D, Wroclaw, Poland.ORCID http://orcid.org/0009-0003-0361-9175
Sebastian MakuchDepartment of Clinical and Experimental Pathology, Wroclaw Medical University, Wroclaw, Poland.ORCID http://orcid.org/0000-0002-9904-1181
Siddarth AgrawalLabplus R&D, Wroclaw, Poland.ORCID http://orcid.org/0000-0003-1118-5090
Grzegorz MazurLabplus R&D, Wroclaw, Poland.ORCID http://orcid.org/0000-0001-6610-2008
Jerzy ChudekDepartment of Internal Medicine and Oncological Chemotherapy, Medical University of Silesia, Reymonta St. 8, Katowice, 40-027, Poland, +48 32 2591 202.ORCID http://orcid.org/0000-0002-6367-7794

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: In recent years, the implementation of artificial intelligence (AI) in health care is progressively transforming medical fields, with the use of clinical decision support systems (CDSSs) as a notable application. Laboratory tests are vital for accurate diagnoses, but their increasing reliance presents challenges. The need for effective strategies for managing laboratory test interpretation is evident from the millions of monthly searches on test results' significance. As the potential role of CDSSs in laboratory diagnostics gains significance, however, more research is needed to explore this area. Objective: The primary objective of our study was to assess the accuracy and safety of LabTest Checker (LTC), a CDSS designed to support medical diagnoses by analyzing both laboratory test results and patients' medical histories. Methods: This cohort study embraced a prospective data collection approach. A total of 101 patients aged ≥18 years, in stable condition, and requiring comprehensive diagnosis were enrolled. A panel of blood laboratory tests was conducted for each participant. Participants used LTC for test result interpretation. The accuracy and safety of the tool were assessed by comparing AI-generated suggestions to experienced doctor (consultant) recommendations, which are considered the gold standard. Results: The system achieved a 74.3% accuracy and 100% sensitivity for emergency safety and 92.3% sensitivity for urgent cases. It potentially reduced unnecessary medical visits by 41.6% (42/101) and achieved an 82.9% accuracy in identifying underlying pathologies. Conclusions: This study underscores the transformative potential of AI-based CDSSs in laboratory diagnostics, contributing to enhanced patient care, efficient health care systems, and improved medical outcomes. LTC's performance evaluation highlights the advancements in AI's role in laboratory medicine.

Indexed as

accuracyAIapplicationapplicationsartificial intelligenceassessmentCDSSclinical decision support systemsdiagnoseshealth carelaboratory testingLabTest Checkermedical fieldsmedical historypatientpatientssymptom checkertooltools

Identifiers

PMID39149851
PMCPMC11337233

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.