ArticleEuropean radiology2024
Of editorial processes, AI models, and medical literature: the Magnetic Resonance Audiometry experiment.
Article in European radiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
3 citing papers in PubMed.
- Figure plagiarism and manipulation, an under-recognised problem in academia.European radiology · 2025Review
- The scientific system must bend to avoid breaking.European radiology · 2024Article
- The Picasso's skepticism on computer science and the dawn of generative AI: questions after the answers to keep "machines-in-the-loop".European radiology experimental · 2024Article
Corrections and comments
- Commented on by
Authors and funding
2 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
The potential of artificial intelligence (AI) in the field of medical research is unquestionable. Nevertheless, the scientific community has raised several concerns about a possible fraudulent use of these tools that might be used to generate inaccurate or, in extreme cases, erroneous messages that could find their way into the literature. In this experiment, we asked a generative AI program to write a technical report on a non-existing Magnetic Resonance Imaging technique called Magnetic Resonance Audiometry, receiving in return a full seemingly technically sound report, substantiated by equations and references. We have submitted this report to an international peer-reviewed indexed journal, passing the first round of review with only minor changes requested. With this experiment, we showed that the current peer-review system, already burdened by the overwhelming increase in number of publications, might be not ready to also handle the explosion of these techniques, showing the urgent need for the entire community to address both the issue of generative AI in scientific literature and probably a more profound discussion on the entire peer-review process. CLINICAL RELEVANCE STATEMENT: Generative AI models are shown to be able to create a full manuscript without any human intervention that can survive peer-review. Given the explosion of these techniques, a profound discussion on the entire peer-review process by the scientific community is mandatory. KEY POINTS: • The scientific community has raised several concerns about a possible fraudulent use of AI in scientific literature. • We asked a generative AI program to write a technical report on a non-existing technique, receiving in return a full technically sound report, substantiated by equations and references, that passed peer-review. • This experiment showed that the current peer-review system might be not ready to handle the explosion of generative AI techniques, advising for a profound discussion on the entire peer-review process.
Indexed as
Identifiers
38451324What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.