Evidence map›Paper›PMID 29576027›Full record

ArticlePublic health nutrition2019

Automatic food detection in egocentric images using artificial intelligence technology.

Wenyan Jia, Yuecheng Li, Ruowei Qu, Thomas Baranowski, Lora E Burke, Hong Zhang, Yicheng Bai, Juliet M Mancino, Guizhi Xu, Zhi-Hong Mao and 1 more

Open access · greenAbstract read
In one paragraph

Article in Public health nutrition, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 44 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
44citing papers in PubMed, 1 pooled it
10.1field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

44 citing papers in PubMed, 1 synthesis or guideline pooled it, 100 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Detecting Eating and Social Presence with All Day Wearable RGB-T....IEEE...International Conference on Connected Health: Applications, Systems and Engineering Technologies. IEEE International Conference on Connected Health: Applications, Systems and Engineering Technologies · 2023
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 4 institutions in 2 countries.

Wenyan Jia1Department of Neurosurgery,University of Pittsburgh,3520 Forbes Avenue,Suite 202,Pittsburgh,PA 15213,USA.
Yuecheng Li1Department of Neurosurgery,University of Pittsburgh,3520 Forbes Avenue,Suite 202,Pittsburgh,PA 15213,USA.
Ruowei Qu1Department of Neurosurgery,University of Pittsburgh,3520 Forbes Avenue,Suite 202,Pittsburgh,PA 15213,USA.
Thomas Baranowski3Department of Pediatrics,Baylor College of Medicine,Houston,TX,USA.
Lora E Burke4School of Nursing,University of Pittsburgh,Pittsburgh,PA,USA.
Hong Zhang5Image Processing Center,Beihang University,Beijing,People's Republic of China.
Yicheng Bai1Department of Neurosurgery,University of Pittsburgh,3520 Forbes Avenue,Suite 202,Pittsburgh,PA 15213,USA.
Juliet M Mancino4School of Nursing,University of Pittsburgh,Pittsburgh,PA,USA.
Guizhi Xu2Department of Biomedical Engineering,Hebei University of Technology,Tianjin,People's Republic of China.
Zhi-Hong Mao6Department of Electrical and Computer Engineering,University of Pittsburgh,Pittsburgh,PA,USA.
Mingui Sun1Department of Neurosurgery,University of Pittsburgh,3520 Forbes Avenue,Suite 202,Pittsburgh,PA 15213,USA.
University of Pittsburgh · USHebei University of Technology · CNBaylor College of Medicine · USBeihang University · CN

Funding

A Unified Sensor System for Ubiquitous Assessment of Diet and Physical ActivityU01HL091736 · NHLBI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI SUN, MINGUI · 2007 to 2010
$2.5M
Wearable eButton for Evaluation of Energy Balance with Environmental Context andR01CA165255 · NCI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI SUN, MINGUI · 2012 to 2015
$1.1M
Minimizing Memory Errors in Child Diet AssessmentR21CA172864 · NCI · BAYLOR COLLEGE OF MEDICINE · PI BARANOWSKI, TOM · 2013 to 2014
$331k
NCI NIH HHS R01 CA165255NCI NIH HHS R21 CA172864NHLBI NIH HHS U01 HL091736
6 · The paper itself

Abstract

objectiveTo develop an artificial intelligence (AI)-based algorithm which can automatically detect food items from images acquired by an egocentric wearable camera for dietary assessment.

designTo study human diet and lifestyle, large sets of egocentric images were acquired using a wearable device, called eButton, from free-living individuals. Three thousand nine hundred images containing real-world activities, which formed eButton data set 1, were manually selected from thirty subjects. eButton data set 2 contained 29 515 images acquired from a research participant in a week-long unrestricted recording. They included both food- and non-food-related real-life activities, such as dining at both home and restaurants, cooking, shopping, gardening, housekeeping chores, taking classes, gym exercise, etc. All images in these data sets were classified as food/non-food images based on their tags generated by a convolutional neural network.

resultsA cross data-set test was conducted on eButton data set 1. The overall accuracy of food detection was 91·5 and 86·4 %, respectively, when one-half of data set 1 was used for training and the other half for testing. For eButton data set 2, 74·0 % sensitivity and 87·0 % specificity were obtained if both 'food' and 'drink' were considered as food images. Alternatively, if only 'food' items were considered, the sensitivity and specificity reached 85·0 and 85·8 %, respectively.

conclusionsThe AI technology can automatically detect foods from low-quality, wearable camera-acquired real-world egocentric images with reasonable accuracy, reducing both the burden of data processing and privacy concerns.

Indexed as

Artificial IntelligenceDiet RecordsImage Processing, Computer-AssistedActivities of Daily LivingAlgorithmsDieteticsHumansPhotographyArtificial intelligenceDeep learningEgocentric imageFood detectionTechnology-assisted dietary intakeestimationWearable device

Identifiers

PMID29576027
PMCPMC8114337
OpenAlexW2794003850

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.