Evidence map›Paper›PMID 17965757›Full record

ArticleEvidence-based complementary and alternative medicine : eCAM2007

Evaluating complex healthcare systems: a critique of four approaches.

Heather Boon, Hugh Macpherson, Sue Fleishman, Sameline Grimsgaard, Mary Koithan, Arne Johan Norheim, Harald Walach

Abstract read
In one paragraph

Article in Evidence-based complementary and alternative medicine : eCAM, 2007. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Management of patients with cancer pain: an evaluation of AGREE II-based clinical practice guidelines.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2025
    Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Whole Systems Research Methods in Health Care: A Scoping Review.Journal of alternative and complementary medicine (New York, N.Y.) · 2019
    Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Review
  13. Article
  14. Review
  15. Observational
  16. Review
  17. Article
  18. Article
  19. Article
  20. Geffen Faculty Highlight Concerns Linking CAIM and Conventional Researchers at UCLA Symposium.Evidence-based complementary and alternative medicine : eCAM · 2010
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Heather BoonUniversity of Toronto, Canada, heather.boon@utoronto.ca
Hugh Macpherson
Sue Fleishman
Sameline Grimsgaard
Mary Koithan
Arne Johan Norheim
Harald Walach

Funding

Department of Health CSA/03/07/010
6 · The paper itself

Abstract

The purpose of this paper is to bring clarity to the emerging conceptual and methodological literature that focuses on understanding and evaluating complex or 'whole' systems of healthcare. An international working group reviewed literature from interdisciplinary or interprofessional groups describing approaches to the evaluation of complex systems of healthcare. The following four key approaches were identified: a framework from the MRC (UK), whole systems research, whole medical systems research described by NCCAM (USA) and a model from NAFKAM (Norway). Main areas of congruence include acknowledgment of the inherent complexity of many healthcare interventions and the need to find new ways to evaluate these; the need to describe and understand the components of complex interventions in context (as they are actually practiced); the necessity of using mixed methods including randomized clinical trials (RCTs) (explanatory and pragmatic) and qualitative approaches; the perceived benefits of a multidisciplinary team approach to research; and the understanding that methodological developments in this field can be applied to both complementary and alternative medicine (CAM) as well as conventional therapies. In contrast, the approaches differ in the following ways: terminology used, the extent to which the approach attempts to be applicable to both CAM and conventional medical interventions; the prioritization of research questions (in order of what should be done first) especially with respect to how the 'definitive' RCT fits into the process of assessing complex healthcare systems; and the need for a staged approach. There appears to be a growing international understanding of the need for a new perspective on assessing complex healthcare systems.

Indexed as

complex interventionsresearch methodswhole systems research

Identifiers

PMID17965757
PMCPMC1978227

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.