Evidence map›Paper›PMID 38229596›Full record

ArticleJRSM open2024

Informing the development of a scoring system for National Health Service Clinical Impact Awards; a Delphi process and simulated scoring exercise.

Gary Abel, Rob Froud, Emma Pitchforth, Bethan Treadgold, Lucy Hocking, Jon Sussex, Marc Elliott, John Campbell

Abstract read
In one paragraph

Article in JRSM open, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Gary AbelUniversity of Exeter Collaboration for Academic Primary Care (APEx), University of Exeter Medical School, Exeter, UK.ORCID https://orcid.org/0000-0003-2231-5161
Rob FroudClinvivo, Edenbridge, Kent, UK.
Emma PitchforthUniversity of Exeter Collaboration for Academic Primary Care (APEx), University of Exeter Medical School, Exeter, UK.
Bethan TreadgoldUniversity of Exeter Collaboration for Academic Primary Care (APEx), University of Exeter Medical School, Exeter, UK.ORCID https://orcid.org/0000-0002-0255-7422
Lucy HockingRAND Europe, Cambridge, UK.
Jon SussexRAND Europe, Cambridge, UK.
Marc ElliottRAND Corporation, Santa Monica, CA, USA.
John CampbellUniversity of Exeter Collaboration for Academic Primary Care (APEx), University of Exeter Medical School, Exeter, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objectives: To establish principles informing a new scoring system for the UK's Clinical Impact Awards and pilot a system based on those principles. Design: A three-round online Delphi process was used to generate consensus from experts on principles a scoring system should follow. We conducted a shadow scoring exercise of 20 anonymised, historic applications using a new scoring system incorporating those principles. Setting: Assessment of clinical excellence awards for senior doctors and dentists in England and Wales. Participants: The Delphi panel comprised 45 members including clinical excellence award assessors and representatives of professional bodies. The shadow scoring exercise was completed by 24 current clinical excellence award assessors. Main outcome measures: The Delphi panel rated the appropriateness of a series of items. In the shadow scoring exercise, a novel scoring system was used with each of five domains rated on a 0-10 scale. Results: Consensus was achieved around principles that could underpin a future scoring system; in particular, a 0-10 scale with the lowest point on the scale reflecting someone operating below the expectations of their job plan was agreed as appropriate. The shadow scoring exercise showed similar levels of reliability between the novel scoring system and that used historically, but with potentially better distinguishing performance at higher levels of performance. Conclusions: Clinical excellence awards represent substantial public spending and thus far the deployment of these funds has lacked a strong evidence base. We have developed a new scoring system in a robust manner which shows improvements over current arrangements.

Indexed as

health policymedical careersmedical managementnon-clinicalother medical managementprofessional conduct and regulation

Identifiers

PMID38229596
PMCPMC10790597

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.