Evidence map›Paper›PMID 40646586›Full record

ArticleTrials2025

Effects of generative artificial intelligence on cognitive effort and task performance: study protocol for a randomized controlled experiment among college students.

Youjie Chen, Yingying Wang, Torsten Wüstenberg, Rene F Kizilcec, Yiwen Fan, Yanfei Li, Bin Lu, Meng Yuan, Junlai Zhang, Ziyue Zhang and 3 more

Registry-linked trialAbstract readClinical Trial Protocol
In one paragraph

Article in Trials, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06511102 (A Randomized Controlled Trial on the Impact of Using Generative Artificial Intelligence on Analytical Writing Performance and Cognitive Abilities), which is not on this map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06511102 nacompletednot on this map

A Randomized Controlled Trial on the Impact of Using Generative Artificial Intelligence on Analytical Writing Performance and Cognitive Abilities

TypeinterventionalSponsorUniversity Hospital HeidelbergRan2024 to 2025Enrolled160ConditionsCognitive Change, Well-Being, PsychologicalArmsGPT Support
3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Article
  3. Strengths and Potential Pitfalls of the Use of Artificial Intelligence in Psychiatric Education and Practice.Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Artificial Intelligence and the future of clinical trials.Contemporary clinical trials communications · 2025
    Article
  8. Article
  9. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Youjie ChenDepartment of Information Science, Cornell University, Ithaca, USA. yc2669@cornell.edu.ORCID http://orcid.org/0000-0002-3725-0172
Yingying WangNeuroimaging for Language, Literacy and Learning Laboratory, Department of Special Education and Communication Disorders, University of Nebraska-Lincoln, Lincoln, NE, USA.
Torsten WüstenbergCore Facility for Neuroscience of Self-Regulation (CNSR), Heidelberg University, Field of Focus 4 (FoF4), Heidelberg, Germany.
Rene F KizilcecDepartment of Information Science, Cornell University, Ithaca, USA.
Yiwen FanHeidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany.
Yanfei LiHeidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany.
Bin LuCenter for Clinical and Epidemiologic Research, Institute of Heart, Lung and Blood Vessel Diseases, Beijing Anzhen Hospital, Capital Medical University, Beijing , Beijing, China.
Meng YuanPeking Union Medical College, Beijing, China.
Junlai ZhangHeidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany.
Ziyue ZhangHeidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany.
Pascal GeldsetzerDepartment of Medicine, Stanford University School of Medicine, Stanford, USA.
Simiao ChenHeidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany.
Till BärnighausenHeidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany.

Funding

Chinese Academy of Medical Sciences & Peking Union Medical College 2024-CFT-QT-034HORIZON EUROPE 101086139
6 · The paper itself

Abstract

backgroundThe advancement of generative artificial intelligence (AI) has shown great potential to enhance productivity in many cognitive tasks. However, concerns are raised that the use of generative AI may erode human cognition due to over-reliance. Conversely, others argue that generative AI holds the promise to augment human cognition by automating menial tasks and offering insights that extend one's cognitive abilities. To better understand the role of generative AI in human cognition, we study how college students use a generative AI tool to support their analytical writing in an educational context. We will examine the effect of using generative AI on cognitive effort, a major aspect of human cognition that reflects the extent of mental resources an individual allocates during the cognitive process. We will also examine the effect on writing performance achieved through the human-generative AI collaboration.

methodsThis study is a randomized controlled lab experiment that compares the effects of using generative AI (intervention group) versus not using it (control group) on cognitive effort and writing performance in an analytical writing task designed as a hypothetical writing class assignment for college students. During the experiment, eye-tracking technology will monitor eye movements and pupil dilation. Functional near-infrared spectroscopy (fNIRS) will collect brain hemodynamic responses. A survey will measure individuals' perceptions of the writing task and their attitudes on generative AI. We will recruit 160 participants (aged 18-35 years) from a German university where the research will be conducted. DISCUSSION: This trial aims to establish the causal effects of generative AI on cognitive effort and task performance through a randomized controlled experiment. The findings aim to offer insights for policymakers in regulating generative AI and inform the responsible design and use of generative AI tools.

trial registrationCLINICALTRIALS: gov NCT06511102. Registered on July 15, 2024. https://clinicaltrials.gov/study/NCT06511102.

Indexed as

Artificial IntelligenceCognitionStudentsWritingAdolescentAdultBrainFemaleGenerative Artificial IntelligenceHumansMaleRandomized Controlled Trials as TopicSpectroscopy, Near-InfraredTask Performance and AnalysisUniversitiesYoung AdultAnalytical writingCognitive effortCritical thinkingEye-trackingFunctional near-infrared spectroscopyGenerative artificial intelligenceHuman cognitionRandomized controlled trial

Identifiers

PMID40646586
PMCPMC12255134

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.