Evidence map›Paper›PMID 40475321›Full record

ArticleCochrane evidence synthesis and methods2024

Assessing qualitative data richness and thickness: Development of an evidence-based tool for use in qualitative evidence synthesis.

Heather M R Ames, Emma F France, Sara Cooper, Mayara S Bianchim, Simon Lewin, Bey-Marrié Schmidt, Isabelle Uny, Jane Noyes

Abstract read
In one paragraph

Article in Cochrane evidence synthesis and methods, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. "It Is a Vicious Circle": Experiences of People Living With Obesity and Chronic Pain: A Qualitative Evidence Synthesis (QES).Obesity reviews : an official journal of the International Association for the Study of Obesity · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Celebrating qualitative research.The British journal of general practice : the journal of the Royal College of General Practitioners · 2025
    Article
  8. Review
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Heather M R AmesDepartment for Systematic Reviews and Health Technology Assessments The Norwegian Institute of Public Health Oslo Norway.ORCID https://orcid.org/0000-0001-8509-7160
Emma F FranceCentre for Healthcare and Community Research, Faculty of Health Sciences and Sport University of Stirling Stirling UK.ORCID 0000-0003-0876-7030
Sara CooperCochrane South Africa, South African Medical Research Council Cape Town South Africa.ORCID 0000-0001-9894-236X
Mayara S BianchimCentre for Healthcare and Community Research, Faculty of Health Sciences and Sport University of Stirling Stirling UK.ORCID https://orcid.org/0000-0003-3082-7984
Simon LewinDepartment of Health Sciences Ålesund Norwegian University of Science and Technology (NTNU) Ålesund Norway.ORCID 0000-0001-7521-9515
Bey-Marrié SchmidtHealth Systems Research Unit South African Medical Research Council Cape Town South Africa.ORCID 0000-0003-1363-171X
Isabelle UnyInstitute for Social Marketing and Health, Faculty of Health Sciences and Sport University of Stirling Stirling UK.ORCID 0000-0002-9548-5332
Jane NoyesSchool of Medical and Health Sciences Bangor University Bangor UK.ORCID 0000-0003-4238-5984

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Well-conducted qualitative evidence syntheses (QESs) can provide invaluable insights into complex phenomena. However, the development of an in-depth understanding depends on the analysis of rich, thick data from the included primary qualitative studies. Sampling may be needed if there are too many eligible studies. Data richness and thickness are among several criteria that can be taken into consideration when sampling studies for inclusion. However, existing tools do not address explicitly the assessment of both data richness and thickness in the context of QES. Methods: To address this gap, we have developed, piloted, and conducted initial user testing of a richness and thickness assessment tool. The tool has been in development since 2014. Three pilot versions from three review teams have been used in six Cochrane reviews. Key members from the original three review teams subsequently came together to create a consensus-based definitive version 1 of the tool. Four review authors piloted the version 1 tool, which has been subject to initial user testing. The version 1 assessment tool consists of two components: assessing the thickness of contextual data and assessing the richness of conceptual data. The accompanying guidance emphasizes the importance of assessing data that addresses the review question. Results: The paper provides guidance on how to apply the tool, emphasizing the importance of reaching a consensus among review authors and fostering a shared understanding of what constitutes rich and thick data in the context of the review. The potential challenges related to the time and resource constraints of this additional review process are acknowledged. Conclusion: Version 1 of the tool represents a significant development in QES methodology, filling a critical gap and enhancing the transparency and rigor of the sampling process. The authors invite feedback from the research community to further test, refine and improve this tool based on wider user experiences.

Indexed as

conceptual richnesscontextual thicknessdata assessmentevaluationframework synthesismeta‐ethnographyQESqualitative evidence synthesisqualitative researchsamplingsystematic reviewthematic synthesistool development

Identifiers

PMID40475321
PMCPMC11795969

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.