Evidence map›Paper›PMID 39090273›Full record

ArticleInsights into imaging2024

The policies on the use of large language models in radiological journals are lacking: a meta-research study.

Jingyu Zhong, Yue Xing, Yangfan Hu, Junjie Lu, Jiarui Yang, Guangcheng Zhang, Shiqi Mao, Haoda Chen, Qian Yin, Qingqing Cen and 8 more

Abstract read
In one paragraph

Article in Insights into imaging, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Jingyu Zhong *Laboratory of Key Technology and Materials in Minimally Invasive Spine Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. wal_zjy@163.com.ORCID http://orcid.org/0000-0002-9817-2294
Yue Xing *Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Yangfan Hu *Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Junjie LuDepartment of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, USA.
Jiarui YangDepartment of Biomedical Engineering, Boston University, Boston, MA, USA.
Guangcheng ZhangDepartment of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Shiqi MaoDepartment of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China.
Haoda ChenDepartment of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Qian YinDepartment of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Qingqing CenDepartment of Dermatology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Run JiangDepartment of Pharmacovigilance, Shanghai Hansoh BioMedical Co., Ltd., Shanghai, China.
Jingshen ChuEditorial Office of Journal of Diagnostics Concepts & Practice, Department of Science and Technology Development, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Yang SongMR Scientific Marketing, Siemens Healthineers Ltd., Shanghai, China.
Minda LuMR Application, Siemens Healthineers Ltd., Shanghai, China.
Defang DingDepartment of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Xiang GeDepartment of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Huan ZhangDepartment of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. huanzhangy@163.com.
Weiwu YaoLaboratory of Key Technology and Materials in Minimally Invasive Spine Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. yaoweiwuhuan@163.com.

Funding

National Natural Science Foundation of China 82302183Yangfan Project of Science and Technology Commission of Shanghai Municipality 22YF1442400
6 · The paper itself

Abstract

objectiveTo evaluate whether and how the radiological journals present their policies on the use of large language models (LLMs), and identify the journal characteristic variables that are associated with the presence.

methodsIn this meta-research study, we screened Journals from the Radiology, Nuclear Medicine and Medical Imaging Category, 2022 Journal Citation Reports, excluding journals in non-English languages and relevant documents unavailable. We assessed their LLM use policies: (1) whether the policy is present; (2) whether the policy for the authors, the reviewers, and the editors is present; and (3) whether the policy asks the author to report the usage of LLMs, the name of LLMs, the section that used LLMs, the role of LLMs, the verification of LLMs, and the potential influence of LLMs. The association between the presence of policies and journal characteristic variables was evaluated.

resultsThe LLM use policies were presented in 43.9% (83/189) of journals, and those for the authors, the reviewers, and the editor were presented in 43.4% (82/189), 29.6% (56/189) and 25.9% (49/189) of journals, respectively. Many journals mentioned the aspects of the usage (43.4%, 82/189), the name (34.9%, 66/189), the verification (33.3%, 63/189), and the role (31.7%, 60/189) of LLMs, while the potential influence of LLMs (4.2%, 8/189), and the section that used LLMs (1.6%, 3/189) were seldomly touched. The publisher is related to the presence of LLM use policies (p < 0.001).

conclusionThe presence of LLM use policies is suboptimal in radiological journals. A reporting guideline is encouraged to facilitate reporting quality and transparency. CRITICAL RELEVANCE STATEMENT: It may facilitate the quality and transparency of the use of LLMs in scientific writing if a shared complete reporting guideline is developed by stakeholders and then endorsed by journals. KEY POINTS: The policies on LLM use in radiological journals are unexplored. Some of the radiological journals presented policies on LLM use. A shared complete reporting guideline for LLM use is desired.

Indexed as

Artificial intelligenceGuidelineMeta-researchNatural language processingRadiology

Identifiers

PMID39090273
PMCPMC11294318

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.