Evidence map›Paper›PMID 27716275›Full record

ReviewHealth research policy and systems2016

Enhancing implementation science by applying best principles of systems science.

Mary E Northridge, Sara S Metcalf

Abstract readReview
In one paragraph

Review in Health research policy and systems, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 66 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
66citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

66 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Simulated retail food environments: A literature review of systems science approaches to advance equity in access to healthy diets.Obesity reviews : an official journal of the International Association for the Study of Obesity · 2025
    Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

6 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Mary E NorthridgeDepartment of Epidemiology & Health Promotion, New York University College of Dentistry, 433 First Avenue, Room 726, New York, NY, 10010, USA. men6@nyu.edu.
Sara S MetcalfDepartment of Geography, The State University of New York at Buffalo, 115 Wilkeson Quad, Ellicott Complex, North Campus, Buffalo, NY, 14261, USA.

Funding

Project-005UL1TR001445 · NCATS · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI BREDELLA, MIRIAM ANTOINETTE, HOCHMAN, JUDITH S · 2015 to 2025
$103.5M
Institutional Clinical and Translational Science AwardUL1TR000038 · NCATS · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI CRONSTEIN, BRUCE NEIL · 2012 to 2014
$16.8M
Integrating Social and Systems Science Approaches to Promote Oral Health EquityR01DE023072 · NIDCR · NEW YORK UNIVERSITY · PI KUNZEL, CAROL, METCALF, SARA · 2012 to 2016
$4.0M
Institutional Clinical and Translational Science AwardKL2TR000053 · NCATS · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI CRONSTEIN, BRUCE NEIL · 2012 to 2014
$899k
NCATS NIH HHS KL2 TR000053NCATS NIH HHS UL1 TR000038NCATS NIH HHS UL1 TR001445NIDCR NIH HHS R01 DE023072
6 · The paper itself

Abstract

backgroundImplementation science holds promise for better ensuring that research is translated into evidence-based policy and practice, but interventions often fail or even worsen the problems they are intended to solve due to a lack of understanding of real world structures and dynamic complexity. While systems science alone cannot possibly solve the major challenges in public health, systems-based approaches may contribute to changing the language and methods for conceptualising and acting within complex systems. The overarching goal of this paper is to improve the modelling used in dissemination and implementation research by applying best principles of systems science. DISCUSSION: Best principles, as distinct from the more customary term 'best practices', are used to underscore the need to extract the core issues from the context in which they are embedded in order to better ensure that they are transferable across settings. Toward meaningfully grappling with the complex and challenging problems faced in adopting and integrating evidence-based health interventions and changing practice patterns within specific settings, we propose and illustrate four best principles derived from our systems science experience: (1) model the problem, not the system; (2) pay attention to what is important, not just what is quantifiable; (3) leverage the utility of models as boundary objects; and (4) adopt a portfolio approach to model building. To improve our mental models of the real world, system scientists have created methodologies such as system dynamics, agent-based modelling, geographic information science and social network simulation. To understand dynamic complexity, we need the ability to simulate. Otherwise, our understanding will be limited. The practice of dynamic systems modelling, as discussed herein, is the art and science of linking system structure to behaviour for the purpose of changing structure to improve behaviour. A useful computer model creates a knowledge repository and a virtual library for internally consistent exploration of alternative assumptions.

conclusionAmong the benefits of systems modelling are iterative practice, participatory potential and possibility thinking. We trust that the best principles proposed here will resonate with implementation scientists; applying them to the modelling process may abet the translation of research into effective policy and practice.

Indexed as

Evidence-Based PracticeModels, BiologicalPolicy MakingPublic HealthResearch DesignSystems AnalysisDelivery of Health CareHealth PolicyHumansScienceTranslational Research, BiomedicalBest principlesComplexityContextHealth equityImplementation scienceModellingOral healthPrimary careScreening at chairsideSystems science

Identifiers

PMID27716275
PMCPMC5050576

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.