ArticleEnvironment international2020
RoB-SPEO: A tool for assessing risk of bias in studies estimating the prevalence of exposure to occupational risk factors from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury.
Article in Environment international, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 32 papers, 12 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
32 citing papers in PubMed, 12 syntheses or guidelines pooled it.
- Quality of drinking water in the United Arab Emirates: a systematic review.BMC public health · 2026Pooled it
- Seroprevalence of hantavirus infection in non-epidemic settings over four decades: a systematic review and meta-analysis.BMC public health · 2024Pooled it
- The Impact of Occupational Exposures on the Risk of Idiopathic Pulmonary Fibrosis: A Systematic Review and Meta-Analysis.Annals of the American Thoracic Society · 2024Pooled it
- Tool to assess risk of bias in studies estimating the prevalence of mental health disorders (RoB-PrevMH).BMJ mental health · 2023Pooled it
- Can we distinguish the roles of demographic and temporal changes in the incidence and prevalence of musculoskeletal disorders? A systematic review.Scandinavian journal of work, environment & health · 2022Pooled it
- Assessor burden, inter-rater agreement and user experience of the RoB-SPEO tool for assessing risk of bias in studies estimating prevalence of exposure to occupational risk factors: An analysis from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury.Environment international · 2022Pooled it
- The prevalence of occupational exposure to noise: A systematic review and meta-analysis from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury.Environment international · 2021Pooled it
- The effect of occupational exposure to noise on ischaemic heart disease, stroke and hypertension: A systematic review and meta-analysis from the WHO/ILO Joint Estimates of the Work-Related Burden of Disease and Injury.Environment international · 2021Pooled it
- Health Services Use and Health Outcomes among Informal Economy Workers Compared with Formal Economy Workers: A Systematic Review and Meta-Analysis.International journal of environmental research and public health · 2021Pooled it
- The effect of exposure to long working hours on alcohol consumption, risky drinking and alcohol use disorder: A systematic review and meta-analysis from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury.Environment international · 2021Pooled it
- Pooled it
- The effect of exposure to long working hours on ischaemic heart disease: A systematic review and meta-analysis from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury.Environment international · 2020Pooled it
- Article
- Integrating chemical-specific information with general approaches to assessing exposure measurement bias in systematic reviews.Environment international · 2025Article
- Protocol of a collaborative evaluation systematized non-systematic reviews by "DESCreview", a Design tool for Evaluating risk of bias/quality in Systematized and sCoping reviews.Archives of public health = Archives belges de sante publique · 2025Article
- The WHO/ILO Joint Estimates approach to occupational risk factor and burden of disease estimation: providing actionable evidence with impact across sectors in countries.Annals of work exposures and health · 2025Article
- Triangulation of epidemiological evidence and risk of bias evaluation: A proposed framework and applied example using formaldehyde exposure and risk of myeloid leukemias.Global epidemiology · 2024Article
- Review
- Conducting evaluations of evidence that are transparent, timely and can lead to health-protective actions.Environmental health : a global access science source · 2022Article
- Towards a framework for systematic reviews of the prevalence of exposure to environmental and occupational risk factors.Environmental health : a global access science source · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
24 authors.
Funding
Abstract
backgroundThe World Health Organization (WHO) and the International Labour Organization (ILO) are developing joint estimates of the work-related burden of disease and injury (WHO/ILO Joint Estimates). For this, systematic reviews of studies estimating the prevalence of exposure to selected occupational risk factors will be conducted to provide input data for estimations of the number of exposed workers. A critical part of systematic review methods is to assess risk of bias (RoB) of individual studies. In this article, we present and describe the development of such a tool, called the Risk of Bias in Studies estimating Prevalence of Exposure to Occupational risk factors (RoB-SPEO) tool; report results from RoB-SPEO's pilot testing; note RoB-SPEO's limitations; and suggest how the tool might be tested and developed further.
methodsSelected existing RoB tools used in environmental and occupational health systematic reviews were reviewed and analysed. From existing tools, we identified domains for the new tool and, if necessary, added new domains. For each domain, we then identified and integrated components from the existing tools (i.e. instructions, domains, guiding questions, considerations, ratings and rating criteria), and, if necessary, we developed new components. Finally, we elicited feedback from other systematic review methodologists and exposure scientists and agreed upon RoB-SPEO. Nine experts pilot tested RoB-SPEO, and we calculated a raw measure of inter-rater agreement (P
resultsOur review found no standard tool for assessing RoB in prevalence studies of exposure to occupational risk factors. We identified six existing tools for environmental and occupational health systematic reviews and found that their components for assessing RoB differ considerably. With the new RoB-SPEO tool, assessors judge RoB for each of eight domains: (1) bias in selection of participants into the study; (2) bias due to a lack of blinding of study personnel; (3) bias due to exposure misclassification; (4) bias due to incomplete exposure data; (5) bias due to conflict of interest; (6) bias due to selective reporting of exposures; (7) bias due to difference in numerator and denominator; and (8) other bias. The RoB-SPEO's ratings are low, probably low, probably high, high or no information. Pilot testing of the RoB-SPEO tool found substantial inter-rater agreement for six domains (range of P
conclusionsWe developed the RoB-SPEO tool for assessing RoB in prevalence studies of exposure to occupational risk factors. The tool will be applied and its performance tested in the ongoing systematic reviews for the WHO/ILO Joint Estimates.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.