Evidence map›Paper›PMID 39658118›Full record

ArticleSaudi medical journal2024

Assessing the accuracy and efficiency of Chat GPT-4 Omni (GPT-4o) in biomedical statistics: Comparative study with traditional tools.

Anusha S Meo, Narmeen Shaikh, Sultan A Meo

Abstract readComparative Study
In one paragraph

Article in Saudi medical journal, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Anusha S MeoFrom the The School of Medicine (AS Meo), Medical Sciences and Nutrition, University of Aberdeen, Scotland, United Kingdom; from the College of Medicine (Shaikh), King Saud University; and from the Department of Physiology (SA Meo), College of Medicine, King Saud University, Riyadh, Kingdom of Saudi Arabia.
Narmeen ShaikhFrom the The School of Medicine (AS Meo), Medical Sciences and Nutrition, University of Aberdeen, Scotland, United Kingdom; from the College of Medicine (Shaikh), King Saud University; and from the Department of Physiology (SA Meo), College of Medicine, King Saud University, Riyadh, Kingdom of Saudi Arabia.
Sultan A MeoFrom the The School of Medicine (AS Meo), Medical Sciences and Nutrition, University of Aberdeen, Scotland, United Kingdom; from the College of Medicine (Shaikh), King Saud University; and from the Department of Physiology (SA Meo), College of Medicine, King Saud University, Riyadh, Kingdom of Saudi Arabia.ORCID https://orcid.org/0000-0001-9820-1852

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo assess the accuracy of ChatGPT-4 Omni (GPT-4o) in biomedical statistics. The recent novel inauguration of Artificial Intelligence ChatGPT-Omni (GPT-4o), has emerged with the potential to analyze sophisticated and extensive data sets, challenging the expertise of statisticians using traditional statistical tools for data analysis.

methodsThis study was performed in the Department of Physiology, College of Medicine, King Saud University, Riyadh, Saudi Arabia, in May 2024. Three datasets in a raw Excel file format were imported onto Statistical Package for the Social Sciences (SPSS) version 29 for data analysis. Based on this analysis, a script of 9 questions was prepared to command GPT-4 Omni, which was used for data analysis for all 3 datasets on Omni. The score and the time were recorded for each result and verified after being compared to the original analysis results performed on SPSS.

resultsGPT-4 Omni scored 73 (85.88%) out of 85 points for all 3 datasets. All datasets took a total of 38.43 minutes to be fully analyzed. Individually, Omni scored 21/25 (84%) for the small dataset in 487.4 seconds, 20/25 (80%) for the middle dataset in 747.02 seconds and 32/35 (91.42%) for the large dataset in 1071 seconds. GPT-4 Omni produced accurate graphs and charts.

conclusionChatGPT-4 Omni scored better over 80% in all 3 statistical datasets in a short period. GPT-4 Omni also produced accurate graphs and charts as commanded however it required explicit commands with clear instructions to avoid errors and omission of results to achieve appropriate results in biomedical data analysis.

Indexed as

Artificial IntelligenceData Interpretation, StatisticalHumansSaudi ArabiaArtificial IntelligenceGPT-4 Omnimedical statisticsstatistical analysis

Identifiers

PMID39658118
PMCPMC11629647

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.