Evidence map›Paper›PMID 39394597›Full record

GuidelineImplementation science : IS2024

Planning for and Assessing Rigor in Rapid Qualitative Analysis (PARRQA): a consensus-based framework for designing, conducting, and reporting.

Christine P Kowalski, Andrea L Nevedal, Erin P Finley, Jessica P Young, Allison A Lewinski, Amanda M Midboe, Alison B Hamilton

Registry-linked trialAbstract readGuideline
In one paragraph

Guideline in Implementation science : IS, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07356843 (Implementing Community Palliative Care for People With Heart Failure), which is not on this map. Cited by 104 papers.

0numbers the graph read from it
0cells of the map it votes in
104citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07356843 recruitingnot on this mapstarted 2025, after this paper: background citation

Implementing Community Palliative Care for People With Heart Failure

TypeobservationalSponsorIndiana UniversityRan2025 to 2028Enrolled20ConditionsCongestive Heart Failure, Congestive Heart Failure(CHF), Congestive Heart Failure (CHF), Congestive Heart Failure ChronicArmsADAPT
3 · Its place in the literature

Who cites it

104 citing papers in PubMed.

  1. Trial
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

44 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Christine P KowalskiCenter for Clinical Management Research, VA Ann Arbor Healthcare System, 2215 Fuller Rd, Ann Arbor, MI, 48105, USA. Christine.Kowalski@va.gov.
Andrea L NevedalCenter for Clinical Management Research, VA Ann Arbor Healthcare System, 2215 Fuller Rd, Ann Arbor, MI, 48105, USA.
Erin P FinleyVA Health Systems Research Center for the Study of Healthcare Innovation, Implementation, and Policy, VA Greater Los Angeles Healthcare System, 16111 Plummer Street, Sepulveda, CA, 91343, USA.
Jessica P YoungSeattle-Denver Center of Innovation (COIN) for Veteran-Centered Value-Driven Care, Seattle, WA, USA.
Allison A LewinskiDurham Center of Innovation to Accelerate Discovery and Practice Transformation, Durham Veterans Affairs Health Care System, 508 Fulton St, Durham, NC, 27705, USA.
Amanda M MidboeCenter for Innovation to Implementation (Ci2i), Palo Alto Health Care System, 795 Willow Rd, Menlo Park, CA, USA.
Alison B HamiltonVA Health Systems Research Center for the Study of Healthcare Innovation, Implementation, and Policy, VA Greater Los Angeles Healthcare System, 16111 Plummer Street, Sepulveda, CA, 91343, USA.

Funding

HSRD VA IK6 HX002836HSRD VA IK6 HX003394
6 · The paper itself

Abstract

backgroundThe use of rapid qualitative methods has increased substantially over the past decade in quality improvement and health services research. These methods have gained traction in implementation research and practice, wherein real-time adjustments are often made to optimize processes and outcomes. This brisk increase begs the questions: what does rigor entail in projects that use rapid qualitative analysis (RQA)? How do we define a pragmatic framework to help research teams design and conduct rigorous and valid rapid qualitative projects? How can authors articulate rigor in their methods descriptions? Lastly, how can reviewers evaluate the rigor of rapid qualitative projects?.

methodsA team of seven interdisciplinary qualitative methods experts developed a framework for ensuring rigor and validity in RQA and methods suitable for this analytic approach. We conducted a qualitative evidence synthesis to identify gaps in the literature and then drew upon literature, standard procedures within our teams, and a repository of rapid qualitative training materials to create a planning and reporting framework. We iteratively refined this framework through 11 group working meetings (60-90 minutes each) over the course of one year and invited feedback on items to ensure their completeness, clarity, and comprehensibility.

resultsThe Planning for and Assessing Rigor in Rapid Qualitative Analysis (PARRQA) framework is organized progressively across phases from design to dissemination, as follows: 1) rigorous design (rationale and staffing), 2) semi-structured data collection (pilot and planning), 3) RQA: summary template development (accuracy and calibration), 4) RQA: matrix analysis (matrices), and 5) rapid qualitative data synthesis. Eighteen recommendations across these sections specify best practices for rigor and validity.

conclusionsRapid qualitative methods play a central role in implementation evaluations, with the potential to yield prompt information and insights about context, processes, and relationships. However, guidance on how to assess rigor is nascent. The PARRQA framework enhances the literature by offering criteria to ensure appropriate planning for and assessment of rigor in projects that involve RQA. This framework provides a consensus-based resource to support high-level qualitative methodological rigor in implementation science.

Indexed as

ConsensusQualitative ResearchResearch DesignHealth Services ResearchHumansImplementation ScienceQuality ImprovementReproducibility of ResultsQualitative methodsRapid qualitative analysisRapid qualitative methodsRapid qualitative studiesRigorValidity

Identifiers

PMID39394597
PMCPMC11468362

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.