Evidence map›Paper›PMID 41430754›Full record

ReviewJournal of Korean medical science2025

Artificial Intelligence in Detecting Statistical Errors: Implications for Authors, Reviewers, and Editors.

Fatima Alnaimat, Abdel Rahman Feras AlSamhori, Husam El Sharu, Leen Othman, Aizhan Oralbek, Olena Zimba

Abstract readReview
In one paragraph

Review in Journal of Korean medical science, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Review
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Fatima AlnaimatDivision of Rheumatology, Department of Internal Medicine, School of Medicine, University of Jordan, Amman, Jordan. f.naimat@ju.edu.jo.ORCID https://orcid.org/0000-0002-5574-2939
Abdel Rahman Feras AlSamhoriSchool of Medicine, University of Jordan, Amman, Jordan.ORCID https://orcid.org/0000-0002-2715-4320
Husam El SharuDepartment of Rheumatology at Case Western University/University Hospitals, Cleveland, OH, USA.ORCID https://orcid.org/0000-0003-4354-7236
Leen OthmanSchool of Medicine, University of Jordan, Amman, Jordan.ORCID https://orcid.org/0009-0006-1462-5601
Aizhan OralbekDepartment of Social Health Insurance and Public Health, South Kazakhstan Medical Academy, Shymkent, Kazakhstan.ORCID https://orcid.org/0009-0003-2616-4660
Olena ZimbaDepartment of Rheumatology, Immunology and Internal Medicine, University Hospital in Kraków, Kraków, Poland.ORCID https://orcid.org/0000-0002-4188-8486

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Choosing the right statistical tests is essential for reliable results, but errors, like picking the wrong test or misinterpreting data, can easily lead to incorrect conclusions. Research integrity implies presenting research that is honest, clear, and uses correct statistics. By identifying statistical errors, artificial intelligence (AI) systems such as Statcheck and GRIM-Test increase the reliability of research and assist reviewers. AI helps non-experts analyze data, but it can be unpredictable for experts dealing with complex data analysis. Still, its ease of use and growing abilities show promise. Recent studies show that AI is increasingly helpful in research, assisting in spotting errors in methodology, citations, and statistical analyses. Tools like LLMs, Black Spatula, YesNoError, and GRIM-Test improve accuracy, but they need good data and human checks. AI has moderate accuracy overall but performs better in controlled settings. The Statcheck and GRIM-Test are especially good at spotting statistical errors. As more studies are retracted, AI offers helpful, albeit imperfect, support. It can speed up peer review and reduce reviewer workload, but it still has limits, such as bias and a lack of expert judgment. AI also brings risks like misreading results, ethical issues, and privacy concerns, so editors must make final decisions. To use AI safely and effectively, large, well-labeled datasets, teamwork across fields, and secure systems are required. Human oversight is always necessary to review research processes and ensure their reliability; humans must make the final decision and utilize AI responsibly.

Indexed as

Artificial IntelligenceData Interpretation, StatisticalPeer Review, ResearchDatasets as TopicHumansReproducibility of ResultsArtificial IntelligencePublicationsScientific MisconductStatistics

Identifiers

PMID41430754
PMCPMC12722777

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.