Evidence map›Paper›PMID 28140319›Full record

ArticleAdvances in nutrition (Bethesda, Md.)2016

Perspective: NutriGrade: A Scoring System to Assess and Judge the Meta-Evidence of Randomized Controlled Trials and Cohort Studies in Nutrition Research.

Lukas Schwingshackl, Sven Knüppel, Carolina Schwedhelm, Georg Hoffmann, Benjamin Missbach, Marta Stelmach-Mardas, Stefan Dietrich, Fabian Eichelmann, Evangelos Kontopantelis, Khalid Iqbal and 5 more

Erratum issuedAbstract read
In one paragraph

Article in Advances in nutrition (Bethesda, Md.), 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 164 papers, 88 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
164citing papers in PubMed, 88 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

164 citing papers in PubMed, 88 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Probiotic Supplementation and Bone Health Parameters in Adults: A Systematic Review and Meta-Analysis.Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA · 2026
    Pooled it
  5. Body mass index and cancer survival: a meta-analysis of cohort studies.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2025
    Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. Pooled it
  16. Pooled it
  17. Pooled it
  18. Pooled it
  19. Pooled it
  20. Pooled it

104 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

15 authors.

Lukas SchwingshacklDepartment of Epidemiology, German Institute of Human Nutrition Potsdam Rehbruecke, Nuthetal, Germany; lukas.schwingshackl@dife.de.ORCID 0000-0003-3407-7594
Sven KnüppelDepartment of Epidemiology, German Institute of Human Nutrition Potsdam Rehbruecke, Nuthetal, Germany.
Carolina SchwedhelmDepartment of Epidemiology, German Institute of Human Nutrition Potsdam Rehbruecke, Nuthetal, Germany.
Georg HoffmannDepartment of Nutritional Sciences, University of Vienna, Vienna, Austria.
Benjamin MissbachDepartment of Nutritional Sciences, University of Vienna, Vienna, Austria.
Marta Stelmach-MardasDepartment of Epidemiology, German Institute of Human Nutrition Potsdam Rehbruecke, Nuthetal, Germany.
Stefan DietrichDepartment of Epidemiology, German Institute of Human Nutrition Potsdam Rehbruecke, Nuthetal, Germany.
Fabian EichelmannNutrition, Immunity, and Metabolism Start-Up Lab.
Evangelos KontopantelisCentre for Primary Care, Institute of Population Health, University of Manchester, Manchester, United Kingdom.
Khalid IqbalDepartment of Epidemiology, German Institute of Human Nutrition Potsdam Rehbruecke, Nuthetal, Germany.
Krasimira AleksandrovaNutrition, Immunity, and Metabolism Start-Up Lab.
Stefan LorkowskiInstitute of Nutrition, Friedrich Schiller University Jena, Jena, Germany.
Michael F LeitzmannDepartment of Epidemiology and Preventive Medicine, University of Regensburg, Regensburg, Germany; and.
Anja KrokeDepartment of Nutritional, Food, and Consumer Sciences, University of Applied Sciences, Fulda, Germany.
Heiner BoeingDepartment of Epidemiology, German Institute of Human Nutrition Potsdam Rehbruecke, Nuthetal, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The objective of this study was to develop a scoring system (NutriGrade) to evaluate the quality of evidence of randomized controlled trial (RCT) and cohort study meta-analyses in nutrition research, building upon previous tools and expert recommendations. NutriGrade aims to assess the meta-evidence of an association or effect between different nutrition factors and outcomes, taking into account nutrition research-specific requirements not considered by other tools. In a pretest study, 6 randomly selected meta-analyses investigating diet-disease relations were evaluated with NutriGrade by 5 independent raters. After revision, NutriGrade was applied by the same raters to 30 randomly selected meta-analyses in the same thematic area. The reliability of ratings of NutriGrade items was calculated with the use of a multirater κ, and reliability of the total (summed scores) was calculated with the use of intraclass correlation coefficients (ICCs). The following categories for meta-evidence evaluation were established: high (8-10), moderate (6-7.99), low (4-5.99), and very low (0-3.99). The NutriGrade scoring system (maximum of 10 points) comprises the following items: 1) risk of bias, study quality, and study limitations, 2) precision, 3) heterogeneity, 4) directness, 5) publication bias, 6) funding bias, 7) study design, 8) effect size, and 9) dose-response. The NutriGrade score varied between 2.9 (very low meta-evidence) and 8.8 (high meta-evidence) for meta-analyses of RCTs, and it ranged between 3.1 and 8.8 for meta-analyses of cohort studies. The κ value of the ratings for each scoring item varied from 0.32 (95% CI: 0.22, 0.42) for risk of bias for cohort studies and 0.95 (95% CI: 0.91, 0.99) for study design, with a mean κ of 0.66 (95% CI: 0.53, 0.79). The ICC of the total score was 0.81 (95% CI: 0.69, 0.90). The NutriGrade scoring system showed good agreement and reliability. The initial findings regarding the performance of this newly established scoring system need further evaluation in independent analyses.

Indexed as

Evaluation Studies as TopicBiomedical ResearchCohort StudiesHumansMeta-Analysis as TopicNutritional SciencesRandomized Controlled Trials as TopicReproducibility of ResultsResearch Designmeta-analysismeta-evidencenutritionreliabilityscoring

Identifiers

PMID28140319
PMCPMC5105044

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.