Evidence map›Paper›PMID 34779122›Full record

SynthesisObesity reviews : an official journal of the International Association for the Study of Obesity2022

Impact of risk of generalizability biases in adult obesity interventions: A meta-epidemiological review and meta-analysis.

Michael W Beets, Lauren von Klinggraeff, Sarah Burkart, Alexis Jones, John P A Ioannidis, R Glenn Weaver, Anthony D Okely, David Lubans, Esther van Sluijs, Russell Jago and 3 more

Open access · hybridAbstract readMeta-AnalysisReview
In one paragraph

Synthesis in Obesity reviews : an official journal of the International Association for the Study of Obesity, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
1.8field-weighted citation impact, top 15% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it, 16 citations in OpenAlex.

  1. Impact of risk of generalizability biases in adult obesity interventions: A meta-epidemiological review and meta-analysis.Obesity reviews : an official journal of the International Association for the Study of Obesity · 2022
    Pooled it
  2. Review
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 6 institutions in 3 countries.

Michael W BeetsDepartment of Exercise Science, Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.
Lauren von KlinggraeffDepartment of Exercise Science, Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.ORCID 0000-0002-4417-0701
Sarah BurkartDepartment of Exercise Science, Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.
Alexis JonesDepartment of Exercise Science, Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.
John P A IoannidisDepartments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA.
R Glenn WeaverDepartment of Exercise Science, Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.
Anthony D OkelyFaculty of the Arts, Social Sciences and Humanities, School of Education, University of Wollongong, Wollongong, New South Wales, Australia.
David LubansSchool of Education, Priority Research Centre in Physical Activity and Nutrition, University of Newcastle, Callaghan, New South Wales, Australia.ORCID 0000-0002-0204-8257
Esther van SluijsCentre for Diet and Activity Research (CEDAR), MRC Epidemiology Unit, School of Clinical Medicine, University of Cambridge, Cambridge, UK.
Russell JagoCentre for Exercise Nutrition and Health Sciences, School for Policy Studies, University of Bristol, Bristol, UK.
Gabrielle Turner-McGrievyDepartment of Health Promotion, Education, and Behavior Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.
James ThrasherDepartment of Health Promotion, Education, and Behavior Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.
Xiaoming LiDepartment of Health Promotion, Education, and Behavior Arnold School of Public Health, University of South Carolina, Columbia, South Carolina, USA.
University of South Carolina · USProtein Metrics (United States) · USUniversity of Bristol · GBUniversity of Cambridge · GBUniversity of Newcastle Australia · AUUniversity of Wollongong · AU

Funding

Targeting Behavioral Adjustment and Healthy Lifestyle in Preschool-Age Children Using an Integrated Family-Based InterventionP20GM130420 · NIGMS · UNIVERSITY OF SOUTH CAROLINA AT COLUMBIA · PI GERACI, MARCO · 2020 to 2024
$11.2M
Biomedical-Behavioral Interface: Prevention and Developmental Sciences TrainingT32GM081740 · NIGMS · UNIVERSITY OF SOUTH CAROLINA AT COLUMBIA · PI PRINZ, RONALD J · 2008 to 2022
$4.5M
A Meta-Epidemiological Assessment of the Role of Pilot Studies in the Design of Well-Powered Trials - the Pilot ProjectR01HL149141 · NHLBI · UNIVERSITY OF SOUTH CAROLINA AT COLUMBIA · PI BEETS, MICHAEL W · 2019 to 2022
$2.4M
The Longitudinal Influence of Home Disorganization on Children's Sleep VariabilityF32HL154530 · NHLBI · UNIVERSITY OF SOUTH CAROLINA AT COLUMBIA · PI BURKART, SARAH · 2020 to 2021
$137k
Predictors of Effective Scaling: A Meta-Epidemiological Study of Bias in Early-Stage Studies to Prevent Chronic DiseaseF31HL158016 · NHLBI · UNIVERSITY OF SOUTH CAROLINA AT COLUMBIA · PI VON KLINGGRAEFF, LAUREN ELIZABETH · 2021 to 2023
$99k
Medical Research Council MC_UU_00006/5Medical Research Council MC_UU_12015/7Medical Research Council MR/K023187/1NHLBI NIH HHS F31 HL158016NHLBI NIH HHS F32 HL154530NHLBI NIH HHS R01 HL149141NIGMS NIH HHS P20 GM130420NIGMS NIH HHS T32 GM081740
6 · The paper itself

Abstract

Biases introduced in early-stage studies can lead to inflated early discoveries. The risk of generalizability biases (RGBs) identifies key features of feasibility studies that, when present, lead to reduced impact in a larger trial. This meta-study examined the influence of RGBs in adult obesity interventions. Behavioral interventions with a published feasibility study and a larger scale trial of the same intervention (e.g., pairs) were identified. Each pair was coded for the presence of RGBs. Quantitative outcomes were extracted. Multilevel meta-regression models were used to examine the impact of RGBs on the difference in the effect size (ES, standardized mean difference) from pilot to larger scale trial. A total of 114 pairs, representing 230 studies, were identified. Overall, 75% of the pairs had at least one RGB present. The four most prevalent RGBs were duration (33%), delivery agent (30%), implementation support (23%), and target audience (22%) bias. The largest reductions in the ES were observed in pairs where an RGB was present in the pilot and removed in the larger scale trial (average reduction ES -0.41, range -1.06 to 0.01), compared with pairs without an RGB (average reduction ES -0.15, range -0.18 to -0.14). Eliminating RGBs during early-stage testing may result in improved evidence.

Indexed as

Behavior TherapyObesityAdultBiasHumansinterventionpilotscalingtranslation

Identifiers

PMID34779122
PMCPMC8755584
OpenAlexW3212617904

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.