Evidence map›Paper›PMID 33312007›Full record

ArticlePatient related outcome measures2020

Patient Experience Monitor (PEM): The Development of New Short-Form Picker Experience Questionnaires for Hospital Patients with a Wide Range of Literacy Levels.

Carla M Bastemeijer, Hileen Boosman, Linda Zandbelt, Reinier Timman, Dolf de Boer, Jan A Hazelzet

Abstract read
In one paragraph

Article in Patient related outcome measures, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Patient-reported outcome measures (PROMs) used among liver transplant recipients: a systematic review and methodological quality appraisal.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Towards Human-Centered Digital Health Interventions.The Psychiatric clinics of North America · 2026
    Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. The first steps in the development of a cancer-specific patient-reported experience measure item bank (PREM-item bank): towards dynamic evaluation of experiences.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2024
    Review
  15. Article
  16. Article
  17. Article
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Carla M BastemeijerDepartment of Public Health, Erasmus University Medical Center, Rotterdam, the Netherlands.
Hileen BoosmanDepartment of Quality & Patient Safety, Leiden University Medical Center, Leiden, the Netherlands.
Linda ZandbeltDepartment of Clinical and Executive Support, Amsterdam University Medical Centers, Amsterdam, the Netherlands.
Reinier TimmanDepartment of Psychiatry, Unit of Medical Psychology & Psychotherapy, Erasmus University Medical Center, Rotterdam, the Netherlands.
Dolf de BoerCare from the Patient Perspective, Nivel, Utrecht, the Netherlands.
Jan A HazelzetDepartment of Public Health, Erasmus University Medical Center, Rotterdam, the Netherlands.ORCID 0000-0002-9414-5539

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeSeveral patient-reported experience measures (PREMs) were developed through the years. These questionnaires are frequently found to be inappropriate for people with lower literacy levels. This paper describes the development of patient experience questionnaires for hospital patients with a wide range of literacy levels, while enabling the potential for quality improvement.

methodsMixed methods were used to adapt Picker Institute patient experience questionnaires: selection of items and adaptation towards language level B1 (the language level of which patients can express their own opinion and describe experiences, events and expectations) by expert panels, usability tests with patients, analysis of psychometric properties and member checking. A theory-driven approach was followed for definitive enrolment of items, meaning that the items eligible for exclusion had been carefully reviewed by the expert team and representatives of a patient council before definitive exclusion.

resultsA pilot study was performed in an University Medical Centre in the Netherlands among in- and outpatients after discharge. Two provisional questionnaires of 22 items, designed by an expert panel, were reduced towards a final selection of 14-15 items. This led to two short-form questionnaires, called Patient Experience Monitor (PEM) Adult Inpatient and PEM Adult Outpatient. To illustrate, the results of the PEM Adult Outpatient questionnaire are presented.

conclusionPEMs are short and valid questionnaires specifically developed to measure patient experiences of hospital patients with a wide range of literacy levels. Acceptance of the questionnaires for both lower and higher educated patients are confirmed by usability tests. The respondents of the pilot study represent both groups. The developed questionnaires should be seen as a dynamic entity and part of a continuous effort to evaluate and improve patient experiences. Future studies are needed to examine the usability of these new questionnaires for quality improvement.

Indexed as

patient centered carepatient experiencesPREMquality in healthcare

Identifiers

PMID33312007
PMCPMC7725101

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.