Evidence map›Paper›PMID 26366885›Full record

Trial reportPloS one2015

Stating Appointment Costs in SMS Reminders Reduces Missed Hospital Appointments: Findings from Two Randomised Controlled Trials.

Michael Hallsworth, Dan Berry, Michael Sanders, Anna Sallis, Dominic King, Ivo Vlaev, Ara Darzi

Erratum issued Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in PloS one, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. It is linked to trial NCT06163222 (Can User-centred Design and Behavioural-science Informed Interventions Improve Equity in Outpatient Access in North West London? A Non-randomised Controlled Trial), which is not on this map. Cited by 29 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06163222 nacompletednot on this mapstarted 2024, after this paper: background citation

Can User-centred Design and Behavioural-science Informed Interventions Improve Equity in Outpatient Access in North West London? A Non-randomised Controlled Trial

TypeinterventionalSponsorImperial College LondonRan2024 to 2024Enrolled13,389ConditionsBehavioural Science Interventions to Improve Health EquityArmsAdditional message with behavioural science-informed content and associated web pages, Usual communication strategy
3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Reducing missed appointments in general practice: evaluation of a quality improvement programme in East London.The British journal of general practice : the journal of the Royal College of General Practitioners · 2021
    Article
  19. Observational
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

7 authors.

Michael HallsworthCentre for Health Policy, Imperial College London, London, United Kingdom; The Behavioural Insights Team, 33 Greycoat Street, London, United Kingdom.
Dan BerryDepartment of Health, Richmond House, 79 Whitehall, London, United Kingdom.
Michael SandersThe Behavioural Insights Team, 33 Greycoat Street, London, United Kingdom; Harvard Kennedy School, 79 John F. Kennedy Street Cambridge, MA, United States of America.
Anna SallisPublic Health England, Skipton House, 80 London Road, London, United Kingdom.
Dominic KingCentre for Health Policy, Imperial College London, London, United Kingdom.
Ivo VlaevWarwick Business School, University of Warwick, Coventry, United Kingdom.
Ara DarziCentre for Health Policy, Imperial College London, London, United Kingdom.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMissed hospital appointments are a major cause of inefficiency worldwide. Healthcare providers are increasingly using Short Message Service reminders to reduce 'Did Not Attend' (DNA) rates. Systematic reviews show that sending such reminders is effective, but there is no evidence on whether their impact is affected by their content. Accordingly, we undertook two randomised controlled trials that tested the impact of rephrasing appointment reminders on DNA rates in the United Kingdom. TRIAL

methodsParticipants were outpatients with a valid mobile telephone number and an outpatient appointment between November 2013 and January 2014 (Trial One, 10,111 participants) or March and May 2014 (Trial Two, 9,848 participants). Appointments were randomly allocated to one of four reminder messages, which were issued five days in advance. Message assignment was then compared against appointment outcomes (appointment attendance, DNA, cancellation by patient).

resultsIn Trial One, a message including the cost of a missed appointment to the health system produced a DNA rate of 8.4%, compared to 11.1% for the existing message (OR 0.74, 95% CI 0.61-0.89, P<0.01). Trial Two replicated this effect (DNA rate 8.2%), but also found that expressing the same concept in general terms was significantly less effective (DNA rate 9.9%, OR 1.22, 95% CI 1.00-1.48, P<0.05). Moving from the existing reminder to the more effective costs message would result in 5,800 fewer missed appointments per year in the National Health Service Trust in question, at no additional cost. The study's main limitations are that it took place in a single location in England, and that it required accurate phone records, which were only obtained for 20% of eligible patients. We conclude that missed appointments can be reduced, for no additional cost, by introducing persuasive messages to appointment reminders. Future studies could examine the impact of varying reminder messages in other health systems.

trial registrationControlled-Trials.com 49432571.

Indexed as

Appointments and SchedulesCosts and Cost AnalysisText MessagingCost-Benefit AnalysisFemaleHumansMaleMiddle AgedReminder Systems

Identifiers

PMID26366885
PMCPMC4569397

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.