Evidence map›Paper›PMID 34193125›Full record

ArticleBMC health services research2021

Electronic health record-integrated approach for collection of patient-reported outcome measures: a retrospective evaluation.

Maggie E Horn, Emily K Reinke, Richard C Mather, Jonathan D O'Donnell, Steven Z George

Abstract read
In one paragraph

Article in BMC health services research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 39 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Factors associated with response to patient-reported outcome measures: a systematic review of systematic and scoping reviews, and meta-analyses.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Pooled it
  2. A Systematic Review of Electronic Medical Record Driven Quality Measurement and Feedback Systems.International journal of environmental research and public health · 2022
    Pooled it
  3. Article
  4. Rehabilitation Underutilization: Using a Model of Rheumatoid Arthritis to Illustrate Unmet Needs.Archives of rehabilitation research and clinical translation · 2026
    Article
  5. Multinational stakeholder engagement to inform future development and refinement of the EuroQol toddler and infant populations (EQ-TIPS).The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  6. Observational
  7. Article
  8. Article
  9. Article
  10. Article
  11. Developing the EuroQol toddler and infant populations (EQ-TIPS) instrument: qualitative analysis of expert views on content validity and conceptual challenges.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Maggie E HornDivision of Physical Therapy, Department of Orthopaedic Surgery, Duke University, 311 Trent Drive, Durham, NC, 27710, USA. maggie.horn@duke.edu.
Emily K ReinkeDivision of Sports Medicine, Department of Orthopaedic Surgery, Duke University, 3475 Erwin Rd, Durham, NC, 27705, USA.
Richard C MatherDivision of Sports Medicine, Department of Orthopaedic Surgery, Duke University, 3475 Erwin Rd, Durham, NC, 27705, USA.
Jonathan D O'DonnellDuke-Margolis Center for Health Policy, Duke University School of Medicine, Durham, NC, USA.
Steven Z GeorgeDepartment of Orthopaedic Surgery and Duke Clinical Research Institute, Duke University, 200 Morris Street, Durham, NC, 27001, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe integration of Patient Reported Outcome Measures (PROMs) into clinical care presents many challenges for health systems. PROMs provide quantitative data regarding patient-reported health status. However, the most effective model for collecting PROMs has not been established. Therefore the purpose of this study is to report the development and preliminary evaluation of the standardized collection of PROMs within a department of orthopedic surgery at a large academic health center.

methodsWe utilized the Users' Guide to Integrating Patient-Reported Outcomes in Electronic Health Records by Gensheimer et al., 2018 as a framework to describe the development of PROMs collection initiative. We framed our initiative by operationalizing the three aspects of PROM collection development: Planning, Selection, and Engagement. Next, we performed a preliminary evaluation of our initiative by assessing the response rate of patients completing PROMs (no. of PROMs completed/no. of PROMs administered) across the entire department (18 clinics), ambulatory clinics only (14 clinics), and hospital-based clinics only (4 clinics). Lastly, we reported on the mean response rates for the top 5 and bottom 5 orthopaedic providers to describe the variability across providers.

resultsWe described the development of a fully-integrated, population health based implementation strategy leveraging the existing resources of our local EHR to maximize clinical utility of PROMs and routine collection. We collected a large volume of PROMs over a 13 month period (n = 10,951) across 18 clinical sites, 7 clinical specialties and over 100 providers. The response rates varied across the department, ranging from 29 to 42%, depending on active status for the portal to the electronic health record (MyChart). The highest single provider mean response rate was 52%, and the lowest provider rate was 13%. Rates were similar between hospital-based (26%) and ambulatory clinics (29%).

conclusionsWe found that our standardized PROMs collection initiative, informed by Gensheimer et al., achieved scope and scale, but faced challenges in achieving a high response rate commensurate with existing literature. However, most studies reported a targeted recruitment strategy within a narrow clinical population. Further research is needed to elucidate the trade-off between scalability and response rates in PROM collection initiatives.

Indexed as

Electronic Health RecordsOrthopedicsHumansPatient Reported Outcome MeasuresRetrospective StudiesElectronic health recordOrthopedicsPatient-reported outcome measuresValue-based care

Identifiers

PMID34193125
PMCPMC8247208

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.