Evidence map›Paper›PMID 31155689›Full record

ArticleJournal of patient-reported outcomes2019

Response rate and costs for automated patient-reported outcomes collection alone compared to combined automated and manual collection.

Yvette Pronk, Peter Pilot, Justus M Brinkman, Ronald J van Heerwaarden, Walter van der Weegen

Abstract read
In one paragraph

Article in Journal of patient-reported outcomes, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Factors associated with response to patient-reported outcome measures: a systematic review of systematic and scoping reviews, and meta-analyses.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Pooled it
  2. Clinical outcomes of ankle fractures in sub-Saharan Africa: a systematic review.European journal of orthopaedic surgery & traumatology : orthopedie traumatologie · 2023
    Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Yvette PronkResearch Department, Kliniek ViaSana, Mill, The Netherlands. y.pronk@viasana.nl.ORCID http://orcid.org/0000-0001-5086-1501
Peter PilotZimmer Biomet NL, Dordrecht, The Netherlands.
Justus M BrinkmanDepartment of orthopaedic surgery, Kliniek ViaSana, Mill, The Netherlands.
Ronald J van HeerwaardenDepartment of orthopaedic surgery, Kliniek ViaSana, Mill, The Netherlands.
Walter van der WeegenDepartment of orthopaedic surgery, Sint Anna Ziekenhuis, Geldrop, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe response rate on patient-reported outcome measurements (PROMs) necessary to adequately evaluate a treatment and improve patient care is unknown. Hospitals generally aim for the highest possible response rate without insight into the increase in costs involved. This study aimed to investigate which PROMs response rate is achievable in relation to the costs in an orthopaedic practice.

methodsIn an observational study, patients planned for orthopaedic surgery were asked to participate per surgical procedure (5769 surgical procedures at 5300 patients). Patient-reported outcomes (PROs) collection with a digital online automated PROMs collection system (minimal effort) was compared to a combined automated system and manual collection (maximal effort). Response rate was calculated preoperative and at two postoperative time points separately, and on all three time points together. Costs were calculated for the study period, per year and per surgical procedure. Calculations were executed for all surgical procedures and for three subgroups: knee arthroplasty, hip arthroplasty and anterior cruciate ligament reconstruction (ACLR).

resultsUsing maximal effort the response rate increased for all surgical procedures compared to minimal effort; the preoperative response rate from 86% to 100% and the postoperative response rates from 55% to 83% (3 or 6 months) and 53% to 83% (12 months). Concerning the response at all three time points for all surgical procedures, minimal effort resulted in 44% response rate and increased to 76% with maximal effort. Lowest postoperative response rates were found in the ACLR group for both maximal and minimal effort. A costs difference of €5.55-€5.98 per surgical procedure between maximal and minimal effort was found.

conclusionsA two times higher PROMs response rate for patients responding at all three time points (44% versus 76%) is achievable with maximal effort compared to the use of an automated PROMs collection system only. Manual collection adds a cost of €5.5-€6 per surgical procedure to automated PROMs collection alone. It is debatable if these additional costs are justifiable from a value-based health care perspective as the response rate for adequate evaluation of a treatment is still unknown.

Indexed as

CostsPatient-reported outcome measurementsResponse rate

Identifiers

PMID31155689
PMCPMC6545294

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.