Evidence map›Paper›PMID 29623869›Full record

ArticlePublic health nutrition2019

Mixed deep learning and natural language processing method for fake-food image recognition and standardization to help automated dietary assessment.

Simon Mezgec, Tome Eftimov, Tamara Bucher, Barbara Koroušić Seljak

Abstract read
In one paragraph

Article in Public health nutrition, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Review
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Machine Learning in Nutrition Research.Advances in nutrition (Bethesda, Md.) · 2022
    Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Review
  18. Review
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Simon Mezgec1Jožef Stefan International Postgraduate School,Ljubljana,Slovenia.ORCID 0000-0003-1663-3286
Tome Eftimov1Jožef Stefan International Postgraduate School,Ljubljana,Slovenia.
Tamara Bucher3Institute of Food,Nutrition and Health (IFNH),ETH Zürich,Zürich,Switzerland.
Barbara Koroušić Seljak2Computer Systems Department,Jožef Stefan Institute,Jamova cesta 39,Ljubljana 1000,Slovenia.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThe present study tested the combination of an established and a validated food-choice research method (the 'fake food buffet') with a new food-matching technology to automate the data collection and analysis.

designThe methodology combines fake-food image recognition using deep learning and food matching and standardization based on natural language processing. The former is specific because it uses a single deep learning network to perform both the segmentation and the classification at the pixel level of the image. To assess its performance, measures based on the standard pixel accuracy and Intersection over Union were applied. Food matching firstly describes each of the recognized food items in the image and then matches the food items with their compositional data, considering both their food names and their descriptors.

resultsThe final accuracy of the deep learning model trained on fake-food images acquired by 124 study participants and providing fifty-five food classes was 92·18 %, while the food matching was performed with a classification accuracy of 93 %.

conclusionsThe present findings are a step towards automating dietary assessment and food-choice research. The methodology outperforms other approaches in pixel accuracy, and since it is the first automatic solution for recognizing the images of fake foods, the results could be used as a baseline for possible future studies. As the approach enables a semi-automatic description of recognized food items (e.g. with respect to FoodEx2), these can be linked to any food composition database that applies the same classification and description system.

Indexed as

Deep LearningDiet RecordsImage Processing, Computer-AssistedNatural Language ProcessingAlgorithmsFood PreferencesHumansNutrition AssessmentFake food buffetFood image recognitionFood matchingFood replicaFood standardization

Identifiers

PMID29623869
PMCPMC6536832

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.