Evidence map›Paper›PMID 17884862›Full record

ArticleBMJ (Clinical research ed.)2007

Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery mortality.

Stephen Westaby, Nicholas Archer, Nicola Manning, Satish Adwani, Catherine Grebenik, Oliver Ormerod, Ravi Pillai, Neil Wilson

Abstract readComparative StudyMulticenter Study
In one paragraph

Article in BMJ (Clinical research ed.), 2007. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Systematic review of discharge coding accuracy.Journal of public health (Oxford, England) · 2012
    Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Surgical research and activity analysis using Hospital Episode Statistics.Annals of the Royal College of Surgeons of England · 2012
    Article
  14. Hospital mortality under surgical care.Annals of the Royal College of Surgeons of England · 2011
    Article
  15. Article
  16. Surgical mortality: Media attack.BMJ (Clinical research ed.) · 2007
    Article
  17. Article
  18. Data sources and performance measurement.BMJ (Clinical research ed.) · 2007
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors.

Stephen WestabyDepartment of Cardiac Surgery, Oxford Radcliffe Hospital NHS Trust, Oxford OX3 9DU. swestaby@AHF.org.uk
Nicholas Archer
Nicola Manning
Satish Adwani
Catherine Grebenik
Oliver Ormerod
Ravi Pillai
Neil Wilson

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo verify or refute the value of hospital episode statistics (HES) in determining 30 day mortality after open congenital cardiac surgery in infants nationally in comparison with central cardiac audit database (CCAD) information.

designExternal review of paediatric cardiac surgical outcomes in England (HES) and all UK units (CCAD), as derived from each database.

settingCongenital heart surgery centres in the United Kingdom. DATA SOURCES: HES for congenital heart surgery and corresponding information from CCAD for the period 1 April 2000 to 31 March 2002. HES was restricted to the 11 English centres; CCAD covered all 13 UK centres.

main outcome measureMortality within 30 days of open heart surgery in infants aged under 12 months.

resultsIn a direct comparison for the years when data from the 11 English centres were available from both databases, HES omitted between 5% and 38% of infants operated on in each centre. A median 40% (range 0-73%) shortfall occurred in identification of deaths by HES. As a result, mean 30 day mortality was underestimated at 4% by HES as compared with 8% for CCAD. In CCAD, between 1% and 23% of outcomes were missing in nine of 11 English centres used in the comparison (predominantly those for overseas patients). Accordingly, CCAD mortality could also be underestimated. Oxford provided the most complete dataset to HES, including all deaths recorded by CCAD. From three years of CCAD, Oxford's infant mortality from open cardiac surgery (10%) was not statistically different from the mean for all 13 UK centres (8%), in marked contrast to the conclusions drawn from HES for two of those years.

conclusionsHospital episode statistics are unsatisfactory for the assessment of activity and outcomes in congenital heart surgery. The central cardiac audit database is more accurate and complete, but further work is needed to achieve fully comprehensive risk stratified mortality data. Given unresolved limitations in data quality, commercial organisations should reconsider placing centre specific or surgeon specific mortality data in the public domain.

Indexed as

Coronary Artery BypassCoronary Care UnitsHeart Defects, CongenitalHospitalizationHospital MortalityHumansInfantInfant, NewbornMedical AuditMedical RecordsTreatment OutcomeUnited Kingdom

Identifiers

PMID17884862
PMCPMC2018792

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.