Evidence map›Paper›PMID 26238395›Full record

ArticleBMJ open2015

Protocol--the RAMESES II study: developing guidance and reporting standards for realist evaluation.

Trisha Greenhalgh, Geoff Wong, Justin Jagosh, Joanne Greenhalgh, Ana Manzano, Gill Westhorp, Ray Pawson

Abstract read
In one paragraph

Article in BMJ open, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 73 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
73citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

73 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Trial
  8. Review
  9. Article
  10. Article
  11. Article
  12. How Is Equity-Based Co-Creation Enacted in Health and Social Services? An Evaluation of Four Case Studies.Health expectations : an international journal of public participation in health care and health policy · 2026
    Article
  13. Article
  14. Article
  15. Article
  16. Loneliness by Design: The Structural Logic of Isolation in Engagement-Driven Systems.International journal of environmental research and public health · 2025
    Review
  17. Review
  18. Article
  19. Article
  20. Article

13 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Trisha GreenhalghNuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
Geoff WongNuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
Justin JagoshCentre for Advancement in Realist Evaluation and Synthesis (CARES), University of Liverpool, Liverpool, UK.
Joanne GreenhalghSociology and Social Policy, University of Leeds, Leeds, UK.
Ana ManzanoSociology and Social Policy, University of Leeds, Leeds, UK.
Gill WesthorpCommunity Matters Pty Ltd, Woodside, South Australia, Australia.
Ray PawsonSociology and Social Policy, University of Leeds, Leeds, UK.

Funding

Department of Health HS&DR/14/19/19
6 · The paper itself

Abstract

introductionRealist evaluation is an increasingly popular methodology in health services research. For realist evaluations (RE) this project aims to: develop quality and reporting standards and training materials; build capacity for undertaking and critically evaluating them; produce resources and training materials for lay participants, and those seeking to involve them.

methodsTo achieve our aims, we will: (1) Establish management and governance infrastructure; (2) Recruit an interdisciplinary Delphi panel of 35 participants with diverse relevant experience of RE; (3) Summarise current literature and expert opinion on best practice in RE; (4) Run an online Delphi panel to generate and refine items for quality and reporting standards; (5) Capture 'real world' experiences and challenges of RE-for example, by providing ongoing support to realist evaluations, hosting the RAMESES JISCmail list on realist research, and feeding problems and insights from these into the deliberations of the Delphi panel; (6) Produce quality and reporting standards; (7) Collate examples of the learning and training needs of researchers, students, reviewers and lay members in relation to RE; (8) Develop, deliver and evaluate training materials for RE and deliver training workshops; and (9) Develop and evaluate information and resources for patients and other lay participants in RE (eg, draft template information sheets and model consent forms) and; (10) Disseminate training materials and other resources.Planned outputs: (1) Quality and reporting standards and training materials for RE. (2) Methodological support for RE. (3) Increase in capacity to support and evaluate RE. (4) Accessible, plain-English resources for patients and the public participating in RE. DISCUSSION: The realist evaluation is a relatively new approach to evaluation and its overall place in the is not yet fully established. As with all primary research approaches, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency.

Indexed as

Delphi TechniqueHealth Services ResearchPublishingResearch PersonnelEDUCATION & TRAINING (see Medical Education & Training)MEDICAL JOURNALISM

Identifiers

PMID26238395
PMCPMC4538260

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.