Evidence map›Paper›PMID 30785402›Full record

ArticleJournal of medical Internet research2019

Toward an Objective Assessment of Implementation Processes for Innovations in Health Care: Psychometric Evaluation of the Normalization Measure Development (NoMAD) Questionnaire Among Mental Health Care Professionals.

Christiaan Vis, Jeroen Ruwaard, Tracy Finch, Tim Rapley, Derek de Beurs, Henk van Stel, Britt van Lettow, Mayke Mol, Annet Kleiboer, Heleen Riper and 1 more

Open access · goldAbstract read
In one paragraph

Article in Journal of medical Internet research, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 45 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
45citing papers in PubMed, 1 pooled it
13.9field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

45 citing papers in PubMed, 1 synthesis or guideline pooled it, 98 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 6 institutions in 2 countries.

Christiaan VisDepartment of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.ORCID 0000-0001-8783-8487
Jeroen RuwaardAmsterdam UMC, Vrije Universiteit, Psychiatry, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.ORCID 0000-0002-4510-997X
Tracy FinchDepartment of Nursing, Midwifery & Health, Northumbria University, Northumbria, United Kingdom.ORCID 0000-0001-8647-735X
Tim RapleyDepartment of Social Work, Education & Community Wellbeing, Northumbria University, Northumbria, United Kingdom.ORCID 0000-0003-4836-4279
Derek de BeursMental Health, Netherlands Institute For Health Services Research (NIVEL), Utrecht, Netherlands.ORCID 0000-0002-0166-6897
Henk van StelJulius Center Research Program Methodology, Department of Public Health, Healthcare Innovation & Evaluation and Medical Humanities, University Medical Center Utrecht, Utrecht, Netherlands.ORCID 0000-0002-3475-9846
Britt van LettowNictiz, The Hague, Netherlands.ORCID 0000-0002-8009-6860
Mayke MolAmsterdam UMC, Vrije Universiteit, Psychiatry, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.ORCID 0000-0001-8568-8497
Annet KleiboerDepartment of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.ORCID 0000-0001-8040-5697
Heleen RiperDepartment of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.ORCID 0000-0002-8144-8901
Jan SmitAmsterdam UMC, Vrije Universiteit, Psychiatry, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.ORCID 0000-0002-2062-8378
GGZ inGeest · NLNorthumbria University · GBVrije Universiteit Amsterdam · NLNationaal ICT Instituut in de Zorg · NLNetherlands Institute for Health Services Research · NLUniversity Medical Center Utrecht · NL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundSuccessfully implementing eMental health (eMH) interventions in routine mental health care constitutes a major challenge. Reliable instruments to assess implementation progress are essential. The Normalization MeAsure Development (NoMAD) study developed a brief self-report questionnaire that could be helpful in measuring implementation progress. Based on the Normalization Process Theory, this instrument focuses on 4 generative mechanisms involved in implementation processes: coherence, cognitive participation, collective action, and reflexive monitoring.

objectiveThe aim of this study was to translate the NoMAD questionnaire to Dutch and to confirm the factor structure in Dutch mental health care settings.

methodsDutch mental health care professionals involved in eMH implementation were invited to complete the translated NoMAD questionnaire. Confirmatory factor analysis (CFA) was conducted to verify interpretability of scale scores for 3 models: (1) the theoretical 4-factor structure, (2) a unidimensional model, and (3) a hierarchical model. Potential improvements were explored, and correlated scale scores with 3 control questions were used to assess convergent validity.

resultsA total of 262 professionals from mental health care settings in the Netherlands completed the questionnaire (female: 81.7%; mean age: 45 [SD=11]). The internal consistency of the 20-item questionnaire was acceptable (.62≤alpha≤.85). The theorized 4-factor model fitted the data slightly better in the CFA than the hierarchical model (Comparative Fit Index=0.90, Tucker Lewis Index=0.88, Root Mean Square Error of Approximation=0.10, Standardized Root Mean Square Residual=0.12, χ

conclusionsNoMAD's theoretical factor structure was confirmed in Dutch mental health settings to acceptable standards but with room for improvement. The hierarchical model might prove useful in increasing the practical utility of the NoMAD questionnaire by combining a total score with information on the 4 generative mechanisms. Future research should assess the predictive value and responsiveness over time and elucidate the conceptual interpretability of NoMAD in eMH implementation practices.

Indexed as

Cross-Sectional StudiesDelivery of Health CareFemaleHumansMaleMental HealthMiddle AgedPsychometricsReproducibility of ResultsSurveys and QuestionnaireseHealtheMental healthimplementation assessmentimplementation sciencenormalization process theorypsychometrics

Identifiers

PMID30785402
PMCPMC6401675
OpenAlexW2910405541

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.