Evidence map›Paper›PMID 41441667›Full record

ArticleVaccines2025

Discriminative Cut-Offs, Concurrent Criterion Validity, and Test-Retest Reliability of the Oxford Vaccine Hesitancy Scale.

Jonathan Kantor, Samantha Vanderslott, Michael Morrison, Robert C Carlisle

Abstract read
In one paragraph

Article in Vaccines, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Jonathan KantorOxford Vaccine Group, University of Oxford, Oxford OX1 2JD, UK.ORCID 0000-0002-3256-3014
Samantha VanderslottOxford Vaccine Group, University of Oxford, Oxford OX1 2JD, UK.ORCID 0000-0001-8685-7758
Michael MorrisonCentre for Health, Law, and Emerging Technologies (HeLEX), University of Oxford, Oxford OX1 2JD, UK.ORCID 0000-0001-6870-6673
Robert C CarlisleInstitute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford OX1 2JD, UK.

Funding

Arts and Humanities Research Council HNR02360National Institute for Health Research HNR02910
6 · The paper itself

Abstract

backgroundValidated instruments can be used to quantify vaccine hesitancy, but few provide transportable operational cut-offs or temporal stability metrics. We evaluated the Oxford Vaccine Hesitancy Scale (OVHS) to quantify discrimination for the self-reported historical COVID-19 vaccine refusal, derive and validate a single operational cut-off across populations, and assess the test-retest reliability.

methodsFive datasets (including one from a repeat administration) comprising 2451 assessments from 1989 demographically representative UK and US respondents were analyzed without pooling. Receiver operating characteristic (ROC) curves with 10,000 bootstrap replications (bias-corrected and accelerated and percentile Cis) were used to quantify discrimination. A Youden's J near-optimal plateau algorithm constrained by a cross-dataset specificity floor (≥0.75) was used to select a transportable cut-off. A prevalence-agnostic aggregate Index of Union (Iuagg) provided secondary confirmation of this cut-off. Cut-off behaviour was visualized with a multi-sample two-graph ROC plot. The six-week test-retest reliability on a UK sample used a two-way mixed-effects, absolute-agreement ICC(A,1).

resultsAUCs ranged 0.760-0.971 across datasets (derivation AUC: 0.960). The Youden plateau spanned scores 34-38; applying the specificity floor yielded an operational cut-off OVHS ≥ 35, which was confirmed by the Iuagg. At ≥35, sensitivity/specificity were 0.73-0.95/0.63-0.87 across samples; negative predictive value exceeded 0.90 in all cohorts. The test-retest reliability was good to excellent, with the OVHS total ICC(A,1) = 0.884 (95% CI 0.863-0.903); subscales ranged from 0.649 to 0.901 and the average-measure ICC(A,2) = 0.939.

conclusionsThe OVHS demonstrates good-to-excellent discrimination for historical COVID-19 vaccine refusal and strong temporal stability. We found a single, transparent, and transportable operational cut-off (≥35). Our cut-off derivation framework is scale- and endpoint-agnostic and may generalize to other hesitancy instruments and decision cut-offs more broadly.

Indexed as

COVID-19cut-offIndex of UnionOxford Vaccine Hesitancy ScalepsychometricsROCtest–retest reliabilityvaccine hesitancyYouden’s J

Identifiers

PMID41441667
PMCPMC12737704

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.