Evidence map›Paper›PMID 27268021›Full record

ArticleImplementation science : IS2016

Operational research as implementation science: definitions, challenges and research priorities.

Thomas Monks

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in Implementation science : IS, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04356274 (Participatory System Dynamics vs Audit and Feedback), which is not on this map. Cited by 26 papers.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed
4.0field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04356274 naenrolling by invitationnot on this mapstarted 2019, after this paper: background citation

Participatory System Dynamics vs Audit and Feedback: A Cluster Randomized Trial of Mechanisms of Implementation Change to Expand Reach of Evidence-based Addiction and Mental Health Care

TypeinterventionalSponsorPalo Alto Veterans Institute for ResearchRan2019 to 2027Enrolled720ConditionsPTSD, Depression, Alcohol Use Disorder, Opioid Use DisorderArmsParticipatory System Dynamics (PSD), Audit and Feedback (AF)
3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 65 citations in OpenAlex.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Development of a framework for the collaborative adaptation of service models for child and family health in diverse settings (CASCADES).Journal of child health care : for professionals working with children in the hospital and community · 2024
    Article
  7. Article
  8. Article
  9. Review
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Tuberculosis Scientific Conferences in Peru: Sharing local evidence for local decisions.Journal of clinical tuberculosis and other mycobacterial diseases · 2021
    Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

1 author at 1 institution in 1 country.

Thomas MonksNIHR CLAHRC Wessex, Faculty of Health Sciences, University of Southampton, Southampton, UK. thomas.monks@soton.ac.uk.
University of Southampton · GB

Funding

Department of Health
6 · The paper itself

Abstract

backgroundOperational research (OR) is the discipline of using models, either quantitative or qualitative, to aid decision-making in complex implementation problems. The methods of OR have been used in healthcare since the 1950s in diverse areas such as emergency medicine and the interface between acute and community care; hospital performance; scheduling and management of patient home visits; scheduling of patient appointments; and many other complex implementation problems of an operational or logistical nature. DISCUSSION: To date, there has been limited debate about the role that operational research should take within implementation science. I detail three such roles for OR all grounded in upfront system thinking: structuring implementation problems, prospective evaluation of improvement interventions, and strategic reconfiguration. Case studies from mental health, emergency medicine, and stroke care are used to illustrate each role. I then describe the challenges for applied OR within implementation science at the organisational, interventional, and disciplinary levels. Two key challenges include the difficulty faced in achieving a position of mutual understanding between implementation scientists and research users and a stark lack of evaluation of OR interventions. To address these challenges, I propose a research agenda to evaluate applied OR through the lens of implementation science, the liberation of OR from the specialist research and consultancy environment, and co-design of models with service users. Operational research is a mature discipline that has developed a significant volume of methodology to improve health services. OR offers implementation scientists the opportunity to do more upfront system thinking before committing resources or taking risks. OR has three roles within implementation science: structuring an implementation problem, prospective evaluation of implementation problems, and a tool for strategic reconfiguration of health services. Challenges facing OR as implementation science include limited evidence and evaluation of impact, limited service user involvement, a lack of managerial awareness, effective communication between research users and OR modellers, and availability of healthcare data. To progress the science, a focus is needed in three key areas: evaluation of OR interventions, embedding the knowledge of OR in health services, and educating OR modellers about the aims and benefits of service user involvement.

Indexed as

Operations ResearchTranslational Research, BiomedicalAmbulatory Care FacilitiesComputer SimulationEmergency Service, HospitalGeneral PracticeHealth Plan ImplementationHumansIschemic Attack, TransientMental DisordersMental Health ServicesModels, TheoreticalResearchUnited Kingdom

Identifiers

PMID27268021
PMCPMC4895878
OpenAlexW2410781041

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.