Evidence map›Paper›PMID 27917143›Full record

ArticleFrontiers in psychology2016

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs.

Salvador Chacón-Moscoso, Susana Sanduvete-Chaves, Milagrosa Sánchez-Martín

Abstract read
In one paragraph

Article in Frontiers in psychology, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. A Systematic Review of Parenting Programs for Southeast Asian Families.Clinical child and family psychology review · 2025
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. A Training Intervention through a 360° Multisource Feedback Model.International journal of environmental research and public health · 2021
    Article
  16. Work Climate Scale in Emergency Services: Abridged Version.International journal of environmental research and public health · 2021
    Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Salvador Chacón-MoscosoHUM-649 Innovaciones Metodológicas en Evaluación de Programas, Departamento de Psicología Experimental, Facultad de Psicología, Universidad de SevillaSevilla, Spain; Universidad Autónoma de ChileSantiago de Chile, Chile.
Susana Sanduvete-ChavesHUM-649 Innovaciones Metodológicas en Evaluación de Programas, Departamento de Psicología Experimental, Facultad de Psicología, Universidad de Sevilla Sevilla, Spain.
Milagrosa Sánchez-MartínDepartment of Psychology, Universidad Loyola Andalucia Sevilla, Spain.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.

Indexed as

checklistcontent validityinter-coder reliabilitymethodological qualityprimary studies

Identifiers

PMID27917143
PMCPMC5114299

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.