Evidence map›Paper›PMID 35723827›Full record

ArticleJournal of patient-reported outcomes2022

Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care.

Afaf Girgis, Adeola Bamgboje-Ayodele, Orlando Rincones, Shalini K Vinod, Sandra Avery, Joseph Descallar, Allan 'Ben' Smith, Belinda Arnold, Anthony Arnold, Victoria Bray and 4 more

Open access · goldAbstract read
In one paragraph

Article in Journal of patient-reported outcomes, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed, 4 pooled it
2.4field-weighted citation impact, top 9% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed, 4 syntheses or guidelines pooled it, 26 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Review
  7. Implementation of an ePRO-based system supporting treatment readiness assessments in lung cancer care: a mixed-methods study.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Article
  8. Article
  9. Article
  10. Adaptation of digital integration of PROMs and PREMs in oncology during implementation: a scoping review.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2026
    Article
  11. Triage tools to inform the prioritisation of physical health services following a diagnosis of cancer: a scoping review.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2025
    Article
  12. Moving beyond barriers: a mixed-method study to develop evidence-based strategies to improve implementation of PROMs in clinical oncology care.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 6 institutions in 1 country.

Afaf GirgisSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia. afaf.girgis@unsw.edu.au.ORCID http://orcid.org/0000-0003-4101-4006
Adeola Bamgboje-AyodeleSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia.
Orlando RinconesIngham Institute for Applied Medical Research, Liverpool, NSW, 1871, Australia.
Shalini K VinodSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia.
Sandra AveryIngham Institute for Applied Medical Research, Liverpool, NSW, 1871, Australia.
Joseph DescallarSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia.
Allan 'Ben' SmithSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia.
Belinda ArnoldWollongong Hospital, Illawarra Shoalhaven Local Health District, Wollongong, NSW, Australia.
Anthony ArnoldWollongong Hospital, Illawarra Shoalhaven Local Health District, Wollongong, NSW, Australia.
Victoria BraySouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia.
Ivana DurcinoskaIngham Institute for Applied Medical Research, Liverpool, NSW, 1871, Australia.
Nicole M RankinSydney School of Public Health, The University of Sydney, Sydney, NSW, 2006, Australia.
PROMPT-Care Implementation Authorship Group
Geoff P DelaneySouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia.
Liverpool Hospital · AUThe University of Sydney · AUUNSW Sydney · AUIngham Institute · AUWollongong Hospital · AUCamden and Campbelltown Hospitals · AU

Funding

The Centre for Oncology Education and Research Translation CONCERT Seed Translational Grant Scheme
6 · The paper itself

Abstract

backgroundTo realize the broader benefits of electronic patient-reported outcome measures (ePROMs) in routine care, we used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to inform the translation of a clinically effective ePROM system (hereafter referred to as the PRM system) into practice. The study aimed to evaluate the processes and success of implementing the PRM system in the routine care of patients diagnosed with lung cancer.

methodA controlled before-and-after mixed-methods study was undertaken. Data sources included a self-report questionnaire and interviews with healthcare providers, electronic health record data for PRMs patients and historical controls, and field notes. Descriptive statistics, logistic regression modelling, negative binomial models, generalized estimating equations and repeated measures ANOVA were used to analyze quantitative data. Qualitative data was thematically analyzed.

resultsA total of 48/79 eligible people diagnosed with lung cancer completed 90 assessments during the 5-month implementation period (RE-AIM reach). Every assessment breached the pre-defined threshold and care coordinators reviewed and actioned 95.6% of breaches, resulting in 146 referrals to allied health services, most frequently for social work (25.3%), dietetics (18.5%), physiotherapy (18.5%) and occupational therapy (17.1%). PRMs patients had significantly fewer visits to the cancer assessment unit for problematic symptoms (M = 0.23 vs. M = 0.43; p = 0.035), and were significantly more likely to be offered referrals (71% vs. 29%, p < 0.0001) than historical controls (RE-AIM effect). The levels of 'organizational readiness for implementing change' (ORIC) did not show much differences between baseline and follow-up, though this was already high at baseline; but significantly more staff reported improved confidence when asking patients to complete assessments (64.7% at baseline vs. 88.2% at follow-up, p = 0.0046), and when describing the assessment tool to patients (64.7% at baseline vs. 76.47% at follow-up, p = 0.0018) (RE-AIM adoption). A total of 78 staff received PRM system training, and 95.6% of the PRM system alerts were actioned (RE-AIM implementation); and all lung cancer care coordinators were engaged with the PRM system beyond the end of the study period (RE-AIM maintenance).

conclusionThis study demonstrates the potential of the PRM system in enhancing the routine care of lung cancer patients, through leveraging the capabilities of automated web-based care options. Research has shown the clear benefits of using electronically collected patient-reported outcome measures (ePROMs) for cancer patients and health services. However, we need to better understand how to implement ePROMs as part of routine care. This study evaluated the processes and outcomes of implementing an ePROMs system in the routine care of patients diagnosed with lung cancer. Key findings included: (a) a majority of eligible patients completed the scheduled assessments; (b) patient concerns were identified in every assessment, and care coordinators reviewed and actioned almost all of these, including making significantly more referrals to allied health services; (c) patients completing assessments regularly were less likely to present to the cancer assessment unit with problematic symptoms, suggesting that ePROMs identified patient concerns early and this led to a timely response to concerns; (d) staff training and engagement was high, and staff reporting increased confidence when asking patients to complete assessments and when describing the assessment tool to patients at the end of the implementation period. This study shows that implementing ePROMs in routine care is feasible and can lead to improvements in patient care.

Identifiers

PMID35723827
PMCPMC9207870
OpenAlexW4283172488

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.