Evidence map›Paper›PMID 27717360›Full record

ReviewThe international journal of behavioral nutrition and physical activity2016

The effect of changing the built environment on physical activity: a quantitative review of the risk of bias in natural experiments.

Jack S Benton, Jamie Anderson, Ruth F Hunter, David P French

Abstract readReview
In one paragraph

Review in The international journal of behavioral nutrition and physical activity, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
51citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

51 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Impacts of built environment changes on physical activity in Canada: a systematic review of natural experiments.Health promotion and chronic disease prevention in Canada : research, policy and practice · 2026
    Pooled it
  2. Impact of structural-level environmental interventions on physical activity: a systematic review.International archives of occupational and environmental health · 2023
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Trial
  10. Article
  11. Article
  12. Article
  13. Natural experiments in the built environment: evaluating impacts on health.Health promotion and chronic disease prevention in Canada : research, policy and practice · 2026
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Jack S BentonSchool of Psychological Sciences, University of Manchester, Coupland 1 Building, Oxford Road, Manchester, M13 9PL, UK.
Jamie AndersonDepartment of Architecture, University of Cambridge, Cambridge, UK.
Ruth F HunterUKCRC Centre of Excellence for Public Health (NI)/Centre for Public Health, Queen's University Belfast, Northern Ireland, UK.
David P FrenchSchool of Psychological Sciences, University of Manchester, Coupland 1 Building, Oxford Road, Manchester, M13 9PL, UK. david.french@manchester.ac.uk.

Funding

British Heart FoundationCancer Research UKDepartment of HealthMedical Research Council G0802045Medical Research Council MC_UU_12015/6Wellcome Trust
6 · The paper itself

Abstract

backgroundEvidence regarding the association of the built environment with physical activity is influencing policy recommendations that advocate changing the built environment to increase population-level physical activity. However, to date there has been no rigorous appraisal of the quality of the evidence on the effects of changing the built environment. The aim of this review was to conduct a thorough quantitative appraisal of the risk of bias present in those natural experiments with the strongest experimental designs for assessing the causal effects of the built environment on physical activity.

methodsEligible studies had to evaluate the effects of changing the built environment on physical activity, include at least one measurement before and one measurement of physical activity after changes in the environment, and have at least one intervention site and non-intervention comparison site. Given the large number of systematic reviews in this area, studies were identified from three exemplar systematic reviews; these were published in the past five years and were selected to provide a range of different built environment interventions. The risk of bias in these studies was analysed using the Cochrane Risk of Bias Assessment Tool: for Non-Randomized Studies of Interventions (ACROBAT-NRSI).

resultsTwelve eligible natural experiments were identified. Risk of bias assessments were conducted for each physical activity outcome from all studies, resulting in a total of fifteen outcomes being analysed. Intervention sites included parks, urban greenways/trails, bicycle lanes, paths, vacant lots, and a senior citizen's centre. All outcomes had an overall critical (n = 12) or serious (n = 3) risk of bias. Domains with the highest risk of bias were confounding (due to inadequate control sites and poor control of confounding variables), measurement of outcomes, and selection of the reported result.

conclusionsThe present review focused on the strongest natural experiments conducted to date. Given this, the failure of existing studies to adequately control for potential sources of bias highlights the need for more rigorous research to underpin policy recommendations for changing the built environment to increase physical activity. Suggestions are proposed for how future natural experiments in this area can be improved.

Indexed as

BiasEnvironment DesignExerciseResearch DesignHumansRiskBuilt environmentNatural experimentsPhysical activityReviewRisk of bias

Identifiers

PMID27717360
PMCPMC5055702

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.