ArticleBMC medical research methodology2024
Evidence pointing toward invalidity of the SF-8 physical and mental scales: a fusion validity assessment.
Article in BMC medical research methodology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
1 citing paper in PubMed.
- The effect of a community-based health behaviour intervention on health-related quality of life in people with Type 2 diabetes in Nepal: a Cluster Randomized Controlled Trial.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025Trial
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThe SF-8™ Short Form Health Survey creates physical and mental health scale scores from responses to eight survey questions. These widely used scales demonstrate reasonable reliablity, and some forms of validity but have not been assessed for fusion validity. We assess the fusion validity of the SF-8 physical and mental health scales, and provide comments assisting fusion validity assessment of other scales.
methodsChecking the fusion validity of a scale requires including the scale and its constituent indicators in a structural equation model that has at least one variable causally downstream from the scale. We assessed fusion validity of the SF-8 physical and mental health scales in the context of work-related variables for care aides working in Canadian long-term care homes. Variables causally downstream from physical and mental health, such as work burnout, permit checking whether the SF-8 indicator items fuse to form cogent physical and mental scales, irrespective of whether those indicators share common-factor foundations.
resultsWe found that the SF-8 physical and mental health scales did not function appropriately. The scales inappropriately claimed effects for several items that had no effects and provided biased estimates of other effects. These deficiencies seem grounded in the scales' developmental history, which implicitly bolstered selection of some causally ambiguous items and paid insufficient attention to component factor model testing.
conclusionOur observations of causal incongruities question whether the SF-8 can provide valid assessments of physical and mental health. However, it would be imprudent to discontinue SF-8 use on the basis of a single study suggesting invalidity. This uncomfortable conclusion can be rechecked by re-analyzing data from any project that employed the SF-8 and recorded even one causal consequence of physical or mental health. The power of fusion validity assessment comes from connecting the recorded consequences simultaneously to both the scale and the items from which that scale is calculated.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.