Evidence map›Paper›PMID 37391897›Full record

SynthesisHealth expectations : an international journal of public participation in health care and health policy2023

Involving patients and caregivers to develop items for a new patient-reported experience measure for older adults attending the emergency department. Findings from a nominal group technique study.

Blair Graham, Jason E Smith, Ffion Barham, Jos M Latour

Open access · goldAbstract readSystematic Review
In one paragraph

Synthesis in Health expectations : an international journal of public participation in health care and health policy, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 1 pooled it
2.2field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 1 synthesis or guideline pooled it, 5 citations in OpenAlex.

  1. Pooled it
  2. Validation of a Patient-Created, Patient-Reported Experience Measure for Inflammatory Bowel Disease in the United Kingdom.Health expectations : an international journal of public participation in health care and health policy · 2026
    Article
  3. Development of the First Patient-Reported Experience Measure (PREM) for Hearing Loss in Audiology Care-My Hearing PREM.Health expectations : an international journal of public participation in health care and health policy · 2026
    Article
  4. Beyond Triage: Cognitive Profiles and ED-To-Inpatient Costs and Resource Pathways in Older Adults.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2026
    Article
  5. Development of the First Patient-Reported Experience Measure (PREM) for Hearing Loss in Audiology Care-My Hearing PREM.Health expectations : an international journal of public participation in health care and health policy · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 2 countries.

Blair GrahamSchool of Nursing and Midwifery, Faculty of Health, University of Plymouth, Plymouth, UK.ORCID 0000-0002-0005-0476
Jason E SmithDepartment of Emergency Medicine, University Hospitals Plymouth NHS Trust, Plymouth, UK.
Ffion BarhamDepartment of Emergency Medicine, University Hospitals Plymouth NHS Trust, Plymouth, UK.
Jos M LatourSchool of Nursing and Midwifery, Faculty of Health, University of Plymouth, Plymouth, UK.
University Hospitals Plymouth NHS Trust · GBCurtin University · AU

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

contextPatient experience is an important component of high-quality care and is linked to improved clinical outcomes across a range of different conditions. Patient-reported experience measures (PREMs) are psychometrically validated instruments designed to identify where strengths and vulnerabilities in care exist. Currently, there is no validated instrument available to measure patient experience among people aged over 65 years attending the emergency department (ED).

objectiveThis paper aims to describe the process of generating, refining and prioritising candidate items for inclusion in a new PREM measuring older adults' experiences in ED (PREM-ED 65).

designOne hundred and thirty-six draft items were generated via a systematic review, interviews with patients and focus groups with ED staff exploring older adults' experiences in the ED. A 1-day multiple stakeholder workshop was then convened to refine and prioritise these items. The workshop entailed a modified nominal groups technique exercise comprised of three discrete parts-(i) item familiarisation and comprehension assessment, (ii) initial voting and (iii) final adjudication. SETTING AND

participantsTwenty-nine participants attended the stakeholder workshop, conducted in a nonhealthcare setting (Buckfast Abbey). The average age of participants was 65.6 years. Self-reported prior experiences of emergency care among the participants included attending the ED as a patient (n = 16, 55.2%); accompanying person (n = 11, 37.9%) and/or as a healthcare provider (n = 7, 24.1%).

resultsParticipants were allocated time to familiarise themselves with the draft items, suggest any improvements to the item structure or content, and suggest new items. Two additional items were proposed by participants, yielding a total of 138 items for prioritisation. Initial prioritisation deemed most items 'critically important' (priority 7-9 out of 9, n = 104, 75.4%). Of these, 70 items demonstrated suitable inter-rater agreement (mean average deviation from the median < 1.04) and were recommended for automatic inclusion. Participants then undertook final adjudication to include or exclude the remaining items, using forced choice voting. A further 29 items were included. Thirty-nine items did not meet the criteria for inclusion.

conclusionsThis study has generated a list of 99 prioritised candidate items for inclusion in the draft PREM-ED 65 instrument. These items highlight areas of patient experience that are particularly important to older adults accessing emergency care. This may be of direct interest to those looking to improve the patient experience for older adults in the ED. For the final stage of development, psychometric validation amongst a real-world population of ED patients is now planned. PATIENT AND PUBLIC CONTRIBUTION: Initial item generation was informed using qualitative research, including interviews with patients in the ED. The opinions of patients and members of the public were integral to achieving outcomes from the prioritisation meeting. The lay chair of the Royal College of Emergency Medicine participated in the meeting and reviewed the results of this study.

Indexed as

CaregiversHealth PersonnelAgedComprehensionEmergency Service, HospitalHumansPatient Reported Outcome Measuresconsensusemergency departmentnominal groupspatient experience

Identifiers

PMID37391897
PMCPMC10485325
OpenAlexW4382777157

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.