Evidence map›Paper›PMID 38216806›Full record

ReviewCurrent osteoporosis reports2024

The Utility of AI in Writing a Scientific Review Article on the Impacts of COVID-19 on Musculoskeletal Health.

Olatundun D Awosanya, Alexander Harris, Amy Creecy, Xian Qiao, Angela J Toepp, Thomas McCune, Melissa A Kacena, Marie V Ozanne

Abstract readReview
In one paragraph

Review in Current osteoporosis reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Article
  3. Is ChatGPT a Reliable Auxiliary Tool in Basic Life Support Training and Education? A Cross-sectional Study.Indian journal of critical care medicine : peer-reviewed, official publication of Indian Society of Critical Care Medicine · 2025
    Article
  4. Review
  5. Review
  6. Review
  7. Review
  8. Review
  9. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Olatundun D AwosanyaDepartment of Orthopaedic Surgery, Indiana University School of Medicine, Indianapolis, IN, USA.
Alexander HarrisDepartment of Orthopaedic Surgery, Indiana University School of Medicine, Indianapolis, IN, USA.
Amy CreecyDepartment of Orthopaedic Surgery, Indiana University School of Medicine, Indianapolis, IN, USA.
Xian QiaoCritical Care, and Sleep Specialists, SMG Pulmonary, Norfolk, VA, USA.
Angela J ToeppDepartment of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA, USA.
Thomas McCuneDepartment of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA, USA.
Melissa A KacenaDepartment of Orthopaedic Surgery, Indiana University School of Medicine, Indianapolis, IN, USA. mkacena@iupui.edu.
Marie V OzanneDepartment of Mathematics and Statistics, Mount Holyoke College, South Hadley, MA, USA. mozanne@mtholyoke.edu.

Funding

Quality Assurance and Quality Control Project Management: Improving Submissions and Study Conduct in the Human Subjects Research Prior Approval ProcessUL1TR002529 · NCATS · INDIANA UNIVERSITY INDIANAPOLIS · PI MOE, SHARON M, WIEHE, SARAH ELIZABETH · 2018 to 2022
$27.2M
Comprehensive Training Program in Musculoskeletal ResearchT32AR065971 · NIAMS · INDIANA UNIVERSITY INDIANAPOLIS · PI ALEXANDER G ROBLING · 2015 to 2026
$4.4M
Angiogenic Therapy: Novel Approaches to Enhance Bone Regeneration in Aging - LOADR01AG060621 · NIA · INDIANA UNIVERSITY INDIANAPOLIS · PI KACENA, MELISSA A, LI, JILIANG · 2019 to 2023
$3.7M
Impacts of SARS-CoV-2 Infection and Age on Musculoskeletal HealthF31AG077931 · NIA · INDIANA UNIVERSITY INDIANAPOLIS · PI AWOSANYA, OLATUNDUN DUPE · 2022 to 2024
$121k
RR&D Research Career Scientist Award ApplicationIK6RX004809 · VA · RLR VA MEDICAL CENTER · PI KACENA, MELISSA A · 2023 to 2025
–
Impact of TPO Treatment on Bone Healing and Angiogenesis in Type 2 DiabetesI01BX003751 · VA · RLR VA MEDICAL CENTER · PI KACENA, MELISSA A · 2017 to 2021
–
"Novel therapeutic approaches to improve fracture healing while reducing pain behavior"I01RX003552 · VA · RLR VA MEDICAL CENTER · PI KACENA, MELISSA A · 2022 to 2025
–
BLRD VA I01 BX003751BLRD VA I01 BX006399NCATS NIH HHS UL1 TR002529NIAMS NIH HHS T32 AR065971NIA NIH HHS F31 AG077931NIA NIH HHS R01 AG060621NIH HHS AR065971NIH HHS F31AG077931RRD VA I01 RX003552RRD VA IK6 RX004809
6 · The paper itself

Abstract

purpose of reviewThere were two primary purposes to our reviews. First, to provide an update to the scientific community about the impacts of COVID-19 on musculoskeletal health. Second, was to determine the value of using a large language model, ChatGPT 4.0, in the process of writing a scientific review article. To accomplish these objectives, we originally set out to write three review articles on the topic using different methods to produce the initial drafts of the review articles. The first review article was written in the traditional manner by humans, the second was to be written exclusively using ChatGPT (AI-only or AIO), and the third approach was to input the outline and references selected by humans from approach 1 into ChatGPT, using the AI to assist in completing the writing (AI-assisted or AIA). All review articles were extensively fact-checked and edited by all co-authors leading to the final drafts of the manuscripts, which were significantly different from the initial drafts. RECENT

findingsUnfortunately, during this process, it became clear that approach 2 was not feasible for a very recent topic like COVID-19 as at the time, ChatGPT 4.0 had a cutoff date of September 2021 and all articles published after this date had to be provided to ChatGPT, making approaches 2 and 3 virtually identical. Therefore, only two approaches and two review articles were written (human and AI-assisted). Here we found that the human-only approach took less time to complete than the AI-assisted approach. This was largely due to the number of hours required to fact-check and edit the AI-assisted manuscript. Of note, the AI-assisted approach resulted in inaccurate attributions of references (about 20%) and had a higher similarity index suggesting an increased risk of plagiarism. The main aim of this project was to determine whether the use of AI could improve the process of writing a scientific review article. Based on our experience, with the current state of technology, it would not be advised to solely use AI to write a scientific review article, especially on a recent topic.

Indexed as

COVID-19Artificial IntelligenceHumansWritingAIBone LossChatGPTCOVID-19FractureOsteoporosisQuerySARS-CoV-2Scientific review article

Identifiers

PMID38216806
PMCPMC10912275

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.