Evidence map›Paper›PMID 36573610›Full record

ArticleHealth services research2023

A comparison of synthetic control approaches for the evaluation of policy interventions using observational data: Evaluating the impact of redesigning urgent and emergency care in Northumberland.

Geraldine M Clarke, Adam Steventon, Stephen O'Neill

Open access · greenAbstract read
In one paragraph

Article in Health services research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
3.8field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 16 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 3 institutions in 1 country.

Geraldine M ClarkeThe Health Foundation, London, UK.ORCID 0000-0001-7249-0289
Adam SteventonOur Future Health, London, UK.ORCID 0000-0001-8247-7520
Stephen O'NeillDepartment of Health Services Research & Policy, London School of Hygiene and Tropical Medicine, London, UK.ORCID 0000-0002-0022-0500
Health Foundation · GBLondon School of Hygiene & Tropical Medicine · GBUniversity of London · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo compare the original synthetic control (OSC) method with alternative approaches (Generalized [GSC], Micro [MSC], and Bayesian [BSC] synthetic control methods) and re-evaluate the impact of a significant restructuring of urgent and emergency care in Northeast England, which included the opening of the UK's first purpose-built specialist emergency care hospital. DATA SOURCES: Simulations and data from Secondary Uses Service data, a single comprehensive repository for patient-level health care data in England. STUDY

designHospital use of individuals exposed and unexposed to the restructuring is compared. We estimate the impact using OSC, MSC, BSC, and GSC applied at the general practice level. We contrast the estimation methods' performance in a Monte Carlo simulation study. DATA COLLECTION/EXTRACTION

methodsHospital activity data from Secondary Uses Service for patients aged over 18 years registered at a general practice in England from April 2011 to March 2019. PRINCIPAL

findingsNone of the methods dominated all simulation scenarios. GSC was generally preferred. In contrast to an earlier evaluation that used OSC, GSC reported a smaller impact of the opening of the hospital on Accident and Emergency (A&E) department (also known as emergency department or casualty) visits and no evidence for any impact on the proportion of A&E patients seen within 4 h.

conclusionsThe simulation study highlights cases where the considered methods may lead to biased estimates in health policy evaluations. GSC was found to be the most reliable method of those considered. Considering more disaggregated data over a longer time span and applying GSC indicates that the specialist emergency care hospitals in Northumbria had less impact on A&E visits and waiting times than suggested by the original evaluation which applied OSC to more aggregated data.

Indexed as

Emergency Medical ServicesAdultBayes TheoremEmergency Service, HospitalHealth PolicyHospitalsHumansMiddle Agedcausal inferencedifference-in-differencesnew care modelsobservational datapolicy evaluationsynthetic control

Identifiers

PMID36573610
PMCPMC10012235
OpenAlexW4312210662

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.