Evidence map›Paper›PMID 40603694›Full record

ArticleJournal of patient-reported outcomes2025

KERMIT: Performance indicators in electronic patient reported outcome measures: a modified Delphi.

Nathaniel Luke Hatton, Mark Baxter, Sally Lewis, Peter S Hall, Katie Spencer

Abstract read
In one paragraph

Article in Journal of patient-reported outcomes, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Nathaniel Luke HattonLeeds Teaching Hospital Trust, Beckett Street, Leeds, LS9 7TF, England. Nathaniel.hatton@nhs.net.ORCID http://orcid.org/0000-0001-6294-8380
Mark BaxterDivision of Cancer Research, Ninewells School of Medicine, University of Dundee, Dundee, Scotland.ORCID https://orcid.org/0000-0002-5773-8650
Sally LewisWelsh Value in Health Centre, Wales, UK.ORCID https://orcid.org/0000-0002-2369-2308
Peter S HallInstitute of Genetics and Cancer, University of Edinburgh, Edinburgh, Scotland. petershall@zohomail.eu.ORCID https://orcid.org/0000-0001-6015-7841
Katie SpencerLeeds Institute of Health Sciences, University of Leeds, Leeds, England.ORCID https://orcid.org/0000-0002-6846-4341

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionThe use of electronic patient reported outcome measures (ePROMs) is increasing in routine cancer care, with benefit demonstrated in improving patient survival, satisfaction and response time. ePROMs represent a complex intervention, with successful implementation reliant upon a range of questionnaires, platform, patient and clinician characteristics alongside the wider organisational readiness and environment. Key performance indicators (KPIs) assess the performance of a system. A KPI framework would offer value in assessing ePROM implementation projects, however the outcomes and indicators of importance are not clear.

methodA modified Delphi methodology was used to define a framework of KPIs for assessing the deployment of ePROMs in routine cancer care. Potential KPIs were identified through literature searches, de-duplicated and allocated to a matrix of domains. Delphi participants were identified through a literature review and study team networks. KPIs were presented to participants for prioritisation using an online platform. A final set of KPIs was identified through two rounds of consensus with participants rating each KPI for relevance.

resultsThe literature search generated a list of 196 potential KPIs of which 48 were considered by 15 experts in the Delphi process. Consensus was reached to include 12 KPIs in the first round and a further 2 KPIs in the second round. Participant's open text responses were analysed, suggesting a number of areas of debate regarding which KPIs are most pertinent. DISCUSSION: This work provides a framework of 14 KPIs, covering those of relevance to patients, clinicians and health services and recognising the acceptability, feasibility and impact of ePROMs. This framework offers a means to appraise the implementation of ePROMs, supporting teams as they implement ePROMs in routine cancer care and other healthcare settings.

Indexed as

NeoplasmsPatient Reported Outcome MeasuresQuality Indicators, Health CareConsensusDelphi TechniqueHumansSurveys and QuestionnairesDelphi studyElectronicePROMSKey performance indicatorsKPIsPROMS

Identifiers

PMID40603694
PMCPMC12222585

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.