ArticleThe Milbank quarterly2022
First Things First: How to Elicit the Initial Program Theory for a Realist Evaluation of Complex Integrated Care Programs.
Article in The Milbank quarterly, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
28 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Understanding pathways from primary health care to universal health coverage outcomes: a realist review.Frontiers in public health · 2026Pooled it
- Implementing women's sexual and reproductive health interventions in prisons: a realist review.BMJ open · 2026Review
- Co-Designing Local Collaboration Between Social Services, Primary Healthcare, and the Third Sector-A Realist Process Evaluation.Health expectations : an international journal of public participation in health care and health policy · 2026Article
- Addressing the complexity of recovery beyond reductionist, diagnosis‑driven care: a realist evaluation of a family-centered, narrative-based child and adolescent psychiatry practice.BMC psychiatry · 2026Article
- Adapting program theory to guide the implementation and evaluation of interventions delivered by advanced practice nurses in Hospital at Home: A programmatic framework for implementation and assessment.International journal of nursing studies advances · 2025Review
- What Enables Implementation of Pain Management Interventions in Intensive Care Units and Why: A Realist Evaluation to Refine Program Theory.Journal of advanced nursing · 2025Article
- Telerehabilitation of patients with stroke: Initial program theories for successful implementation.PM & R : the journal of injury, function, and rehabilitation · 2025Article
- Article
- Assessing a Person-Centered and Culturally Sensitive Intervention for Arabic-, Turkish, or Urdu-Speaking Individuals With Type 2 Diabetes: Protocol for a Mixed Methods Realist Evaluation Study.JMIR research protocols · 2025Article
- Exploring what works in mental health education for health profession students: a realist review.BMC medical education · 2025Review
- Article
- Applying Realist Retroduction to EHR-Based Clinical Decision Support Tool Development.International journal of qualitative methods · 2025Article
- Integrated health checks as a person-centred approach to systematic screening of household tuberculosis contacts: A realist-informed mixed-methods study.PLOS global public health · 2025Article
- Article
- A Realist Review Protocol into the Contexts and Mechanisms That Enable the Inclusion of Environmental Sustainability Outcomes in the Design of Lean Healthcare Improvement Interventions.International journal of environmental research and public health · 2024Article
- Rapid Review on the Concept of Positive Health and Its Implementation in Practice.Healthcare (Basel, Switzerland) · 2024Review
- What works for whom, how and why in mental health education for undergraduate health profession students? A realist synthesis protocol.BMJ open · 2024Article
- The role of provincial health administration in supporting district health management teams in the Democratic Republic of Congo: eliciting an initial programme theory of a realist evaluation.Health research policy and systems · 2024Review
- Enhanced or hindered research benefits? A realist review of community engagement and participatory research practices for non-communicable disease prevention in low- and middle-income countries.BMJ global health · 2024Review
- Effective factors in planning, implementation, and management of educational program evaluation in medical sciences: A practical guide.Journal of education and health promotion · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Policy Points Realist evaluation (RE) is an emerging and promising research approach for evaluating integrated care, addressing what works, how, for whom, and in what circumstances. The rich philosophical foundation of RE, critical realism, can help to systematically unravel an integrated care program's initial theory prior to implementation, as a first step within RE. RE can be considered a robust methodological asset in integrated care research by facilitating a deeper level of insight into program functioning than traditional forms of evaluation do and by shaping a realist-informed monitoring and evaluation process. CONTEXT: The complexity of integrated care and the need for transferable evaluation insights ask for a suitable evaluation paradigm. Realist evaluation (RE), underpinned by the philosophy of critical realism, is a theory-driven approach that addresses what works, how, for whom, and in what circumstances. The current study illustrates the process needed for RE's first step: eliciting the initial program theory (IPT). The TARGET program, a Dutch primary care initiative to facilitate more integrated care for chronically ill patients, i.e., care that is efficient, tailored, and holistic, was taken as a real-world case.
methodsAn RE approach informed the phased IPT elicitation: (1) identifying an abstract theory framework; (2) formulating the preliminary IPT, building on the abstract theory and informed by previous scientific studies that underpin TARGET; and (3) refining the preliminary IPT, informed by RE expert interviews (n = 7). An RE heuristic tool, specifying the interplay between intervention-context-actors-mechanisms-outcomes (ICAMO) and retroductive reasoning, was applied to synthesize the underlying theory of individual TARGET components into TARGET's IPT.
findingsSeparate but related IPTs were identified for the two main types of actors involved in TARGET: primary care professionals (PCPs) and patients. For both actors, two sorts of mechanisms are assumed to be activated by TARGET, which-via instrumental outcomes-contribute to long-term quadruple aim targets. The first is confidence to enhance PCPs' person-centered conversational skills and to increase patients' active engagement in TARGET. The second is mutual trust, between PCPs and patients and between PCPs and their network partners. A supportive context is assumed crucial for activating these mechanisms-for example, sufficient resources to invest in integrated care.
conclusionsAlthough the IPT elicitation process is time intensive and requires a mind shift, it facilitates a deeper insight into program functioning than accommodated by the prevailing experimental designs in integrated care. Furthermore, the design of a realist-informed evaluation process can be informed by the IPT.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.