Evidence map›Paper›PMID 41138916›Full record

ArticleThe American journal of clinical nutrition2025

Customized multimodal Diabot-GPT-4o enhances accuracy of image-based dietary assessments in dietetic trainees in Taiwan: validation against weighed food records.

Yu Jie Chen, Chun-Chao Chang, Yen Nhi Hoang, Annie W Lin, Wen-Ling Lin, Cheng-Yu Lin, Ellyn Patricia, Janice Clarisa Tissadharma, Jovan Kuanca, Natasya Nobelta and 4 more

Abstract readValidation Study
In one paragraph

Article in The American journal of clinical nutrition, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Yu Jie ChenSchool of Nutrition and Health Sciences, College of Nutrition, Taipei Medical University, Taipei, Taiwan.
Chun-Chao ChangDivision of Gastroenterology and Hepatology, Department of Internal Medicine, Taipei Medical University Hospital, Taipei, Taiwan; Division of Gastroenterology and Hepatology, Department of Internal Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan; TMU Research Center for Digestive Medicine, Taipei Medical University, Taipei, Taiwan.
Yen Nhi HoangSchool of Nutrition and Health Sciences, College of Nutrition, Taipei Medical University, Taipei, Taiwan.
Annie W LinThe Hormel Institute, University of Minnesota, Austin, MN, United States.
Wen-Ling LinSchool of Nutrition and Health Sciences, College of Nutrition, Taipei Medical University, Taipei, Taiwan.
Cheng-Yu LinSchool of Nutrition and Health Sciences, College of Nutrition, Taipei Medical University, Taipei, Taiwan.
Ellyn PatriciaDepartment of Food Science and Nutrition, Indonesia International Institute for Life Sciences (i3L), Jakarta, Indonesia.
Janice Clarisa TissadharmaDepartment of Food Science and Nutrition, Indonesia International Institute for Life Sciences (i3L), Jakarta, Indonesia.
Jovan KuancaDepartment of Food Science and Nutrition, Indonesia International Institute for Life Sciences (i3L), Jakarta, Indonesia.
Natasya NobeltaDepartment of Food Science and Nutrition, Indonesia International Institute for Life Sciences (i3L), Jakarta, Indonesia.
Kimberly Alecia TheoDepartment of Food Science and Nutrition, Indonesia International Institute for Life Sciences (i3L), Jakarta, Indonesia.
Dang Khanh Ngan HoFaculty of Nursing and Midwifery Hong Bang International University, Ho Chi Minh City, Vietnam.
Pin-Hui WeiDepartment of Nutrition, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan.
Jung-Su ChangSchool of Nutrition and Health Sciences, College of Nutrition, Taipei Medical University, Taipei, Taiwan; TMU Research Center for Digestive Medicine, Taipei Medical University, Taipei, Taiwan; Graduate Institute of Metabolism and Obesity Sciences, College of Nutrition, Taipei Medical University, Taipei, Taiwan; Nutrition Research Center, Taipei Medical University Hospital, Taipei, Taiwan; Chinese Taipei Society for the Study of Obesity (CTSSO), Taipei, Taiwan. Electronic address: susanchang@tmu.edu.tw.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAutomated image-based dietary assessments (IBDAs) using multimodal artificial intelligence (AI) chatbots show strong potential. However, sources of error at the human-AI interface in real-world use remain unclear.

objectivesIn this study, we validated a GPT-4o-powered chatbot for automated IBDAs and identified key sources of error in free-living settings.

methodsIn total, 714 food images were collected from 3-d weighed food records (WFRs) across 171 d from 57 young adults. Images were analyzed using 4 AI configurations: Diabot (DB), DBFN (customized GPT-4o), 4o, and 4oFN (noncustomized), where "FN" indicates inclusion of the food name input. Portion sizes and nutrient estimates were compared with WFRs using Bland-Altman plots with equivalence testing at ±10%, ±15%, and ±20% bounds.

resultsUsing images alone, DB recognized 74% of food items versus 59% for 4o. All AI configurations provided accurate estimates of portion sizes (±10%-15%, coefficient of variation [CV]: 13%), energy (±10%-20%, CV: 14%), and carbohydrates (CHOs; ±15%-20%, CV: 15%) but showed less consistency for fats (±10%-22%, CV: 24%) and proteins (±10%->20.2%, CV: 18%). The custom DBFN outperformed 4oFN, achieving higher accuracy across more nutrients within the ±10% (weight, energy, fats, saturated fats, potassium, and magnesium), ±15% (proteins and sodium), and ±20% (CHOs and calcium) bounds and achieved the highest agreement with WFRs (Spearman's ρ = 0.863-0.662; Lin's concordance correlation coefficient = 0.874-0.540). Common errors at the human-AI interface included inaccurate portion-size estimates, obscured food visibility in images, poorly constructed prompts, omission or intrusion errors, and system-specific limitations, such as processing overload and configuration inconsistencies.

conclusionsCustomized AI chatbots improved automated IBDAs, yet accuracy depends on clear images for food visibility and portion-size fidelity. Standardized AI-input procedures (FN, cooking state, prompt structure, and configuration) and expert oversight to detect and correct AI hallucinations (fabricated items, units, or quantities) remain essential for reliable, interpretable estimates.

Indexed as

DieteticsDiet RecordsNutrition AssessmentAdultFemaleHumansMalePortion SizeReproducibility of ResultsTaiwanYoung Adultartificial intelligenceChatGPTcustomized GPTdigital healthfood recognitiongenerative AIimage-based dietary assessmentlarge language modelportion estimationvirtual dietitian

Identifiers

PMID41138916
PMCPMC12799367

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.