Evidence map›Paper›PMID 33851326›Full record

ArticleQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation2021

Initial quantitative development of the Norse Feedback system: a novel clinical feedback system for routine mental healthcare.

Andrew A McAleavey, Samuel S Nordberg, Christian Moltu

Open access · hybridAbstract read
In one paragraph

Article in Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
4.6field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 31 citations in OpenAlex.

  1. Moving beyond global scores: the added value of clinical dimensions for assessing HRQoL in mental disorders.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Article
  2. Article
  3. Scaling out a Digital-First Behavioral Health Care Model to Primary Care.Administration and policy in mental health · 2025
    Article
  4. Article
  5. Response processes for patients providing quantitative self-report data: a qualitative study.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2024
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Complexity and potentials of clinical feedback in mental health: an in-depth study of patient processes.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2021
    Article
  12. Using feedback tools to enhance the quality and experience of care.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2021
    Article
  13. Continuous quality improvement in measure development: Lessons from building a novel clinical feedback system.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2021
    Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 3 institutions in 2 countries.

Andrew A McAleaveyCenter for Health Research, Helse Førde, Førde, 6807, Norway. andrew.athan.mcaleavey@helse-forde.no.ORCID http://orcid.org/0000-0001-5986-2033
Samuel S NordbergHarvard School of Population Medicine, District General Hospital of Førde, Cambridge, MA, UK.
Christian MoltuDistrict General Hospital of Førde, Førde, Norway.
Cornell University · USHelse Førde · NOWestern Norway University of Applied Sciences · NO

Funding

Norges Forskningsråd (NO) 269097
6 · The paper itself

Abstract

purposeAs routine outcome monitoring has become prevalent in psychological practice, there is need for measurement tools covering diverse symptoms, treatment processes, patient strengths, and risks. Here we describe the development and initial tests of the psychometric properties of a multi-scale system for use in mental healthcare, Norse Feedback.

methodsIn Study 1, we present the item-generation process and structure of the Norse Feedback, a 17-scale digital-first measurement tool for psychopathology and treatment-relevant variables. In Study 2, we present analyses of this initial measure in a nonclinical sample of 794 healthy controls and a sample of 222 mental health patients. In Study 3, we present the analysis of a revised 20-scale system in two separate samples of patients. In each analysis, we investigate item and test information in particular, including analysis of differential item functioning on gender, age, site, and sample differences where applicable.

resultsScales performed variably. Changes to items and scales are described. Several scales appeared to reliably discriminate individuals entering mental health treatment on severity, and others are less reliable. Marked improvements in scale internal consistency and measurement precision were observed between the first and second implemented versions.

conclusionThis system includes some scales with reasonable structural validity, though several areas for future development are identified. The system was developed to be iteratively re-evaluated, to strengthen the validity of its scales over time. There are currently a number of limitations on inferences from these scores, which future developments should address.

Indexed as

Mental Health ServicesQuality of LifeFeedbackHumansMental HealthPsychometricsReproducibility of ResultsSurveys and QuestionnairesClinical feedback systemsItem response theoryMeasure developmentPsychometric scale analysisRoutine outcome monitoring

Identifiers

PMID33851326
PMCPMC8528796
OpenAlexW3156790947

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.