Evidence map›Paper›PMID 30229870›Full record

Observational studyThe British journal of surgery2019

Accuracy of surgical complication rate estimation using ICD-10 codes.

A Storesund, A S Haugen, M Hjortås, M W Nortvedt, H Flaatten, G E Eide, M A Boermeester, N Sevdalis, E Søfteland

Registry-linked trialAbstract readMulticenter StudyObservational Study
In one paragraph

Observational study in The British journal of surgery, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05523713 (Development and Validation of a Predictive Score for Surgical Site Infections), which is not on this map. Cited by 37 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
37citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05523713 nacompletednot on this mapstarted 2022, after this paper: background citation

Development and Validation of a Predictive Score for Surgical Site Infections (SSI): a Prospective Preoperative Trial in Major Digestive Surgery

TypeinterventionalSponsorHopital FochRan2022 to 2025Enrolled283ConditionsColon or Colorectal Resection, Partial or Total Gastrectomy, Pancreaticoduodenectomy, HepatectomyArmsPeripheral venous blood samples
3 · Its place in the literature

Who cites it

37 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Predictive values of trigger tools for identifying adverse events in hospitalized patients using a medical record review: a systematic review.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2025
    Pooled it
  2. Trial
  3. Article
  4. Observational
  5. Article
  6. Article
  7. Article
  8. Article
  9. Observational
  10. Article
  11. Observational
  12. Article
  13. Article
  14. Review
  15. Article
  16. Adapting the World Health Organization's Surgical Safety Checklist to High-Income Settings: A Hybrid Effectiveness-Implementation Trial Protocol.Annals of surgery open : perspectives of surgical history, education, and clinical approaches · 2024
    Article
  17. A scoping review of the methodological approaches used in retrospective chart reviews to validate adverse event rates in administrative data.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2024
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

A StoresundDepartment of Anaesthesia and Intensive Care, Haukeland University Hospital, Bergen, Norway.ORCID 0000-0003-3252-1874
A S HaugenDepartment of Anaesthesia and Intensive Care, Haukeland University Hospital, Bergen, Norway.
M HjortåsDepartment of Surgery, Førde Central Hospital, Førde, Norway.
M W NortvedtCentre for Evidence-Based Practice, Western Norway University of Applied Sciences, Bergen, Norway.
H FlaattenDepartment of Anaesthesia and Intensive Care, Haukeland University Hospital, Bergen, Norway.
G E EideCentre for Clinical Research, Haukeland University Hospital, Bergen, Norway.
M A BoermeesterDepartment of Surgery, Academic Medical Centre Amsterdam, Amsterdam, the Netherlands.
N SevdalisCentre for Implementation Science, Health Service and Population Research Department, King's College London, London, UK.
E SøftelandDepartment of Anaesthesia and Intensive Care, Haukeland University Hospital, Bergen, Norway.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe ICD-10 codes are used globally for comparison of diagnoses and complications, and are an important tool for the development of patient safety, healthcare policies and the health economy. The aim of this study was to investigate the accuracy of verified complication rates in surgical admissions identified by ICD-10 codes and to validate these estimates against complications identified using the established Global Trigger Tool (GTT) methodology.

methodsThis was a prospective observational study of a sample of surgical admissions in two Norwegian hospitals. Complications were identified and classified by two expert GTT teams who reviewed patients' medical records. Three trained reviewers verified ICD-10 codes indicating a complication present on admission or emerging in hospital.

resultsA total of 700 admissions were drawn randomly from 12 966 procedures. Some 519 possible complications were identified in 332 of 700 admissions (47·4 per cent) from ICD-10 codes. Verification of the ICD-10 codes against information from patients' medical records confirmed 298 as in-hospital complications in 141 of 700 admissions (20·1 per cent). Using GTT methodology, 331 complications were found in 212 of 700 admissions (30·3 per cent). Agreement between the two methods reached 83·3 per cent after verification of ICD-10 codes. The odds ratio for identifying complications using the GTT increased from 5·85 (95 per cent c.i. 4·06 to 8·44) to 25·38 (15·41 to 41·79) when ICD-10 complication codes were verified against patients' medical records.

conclusionVerified ICD-10 codes strengthen the accuracy of complication rates. Use of non-verified complication codes from administrative systems significantly overestimates in-hospital surgical complication rates.

Indexed as

AdolescentAdultAgedAged, 80 and overClinical CodingFemaleHumansInternational Classification of DiseasesLength of StayMaleMiddle AgedNorwayOperative TimePostoperative ComplicationsProspective StudiesSensitivity and Specificity

Identifiers

PMID30229870
PMCPMC6519147

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.