Evidence map›Paper›PMID 33693687›Full record

ArticleInternational journal for quality in health care : journal of the International Society for Quality in Health Care2021

Accuracy and reliability of injury coding in the national Dutch Trauma Registry.

Eric Twiss, Pieta Krijnen, Inger Schipper

Open access · greenAbstract read
In one paragraph

Article in International journal for quality in health care : journal of the International Society for Quality in Health Care, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
4.6field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it, 18 citations in OpenAlex.

  1. Pooled it
  2. Timing of fracture fixation for femur and pelvis fractures in patients with severe traumatic brain injury - an analysis of the TraumaRegister DGUEuropean journal of trauma and emergency surgery : official publication of the European Trauma Society · 2026
    Article
  3. Early discharges in severely injured patients by ISS score: exploring injury patterns and coding practices.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. [Consistency of injury severity score in severe trauma patients].Beijing da xue xue bao. Yi xue ban = Journal of Peking University. Health sciences · 2024
    Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 1 institution in 1 country.

Eric TwissDepartment of Trauma Surgery, Leiden University Medical Center, PO Box 9600, 2300 RC Leiden, The Netherlands.
Pieta KrijnenDepartment of Trauma Surgery, Leiden University Medical Center, PO Box 9600, 2300 RC Leiden, The Netherlands.
Inger SchipperDepartment of Trauma Surgery, Leiden University Medical Center, PO Box 9600, 2300 RC Leiden, The Netherlands.
Leiden University Medical Center · NL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveInjury coding is well known for lack of completeness and accuracy. The objective of this study was to perform a nationwide assessment of accuracy and reliability on Abbreviated Injury Scale (AIS) coding by Dutch Trauma Registry (DTR) coders and to determine the effect on Injury Severity Score (ISS). Additionally, the coders' characteristics were surveyed.

methodsThree fictional trauma cases were presented to all Dutch trauma coders in a nationwide survey (response rate 69%). The coders were asked to extract and code the cases' injuries according to the AIS manual (version 2005, update 2008). Reference standard was set by three highly experienced coders. Summary statistics were used to describe the registered AIS codes and ISS distribution. The primary outcome measures were accuracy of injury coding and inter-rater agreement on AIS codes. Secondary outcome measures were characteristics of coders: profession, work setting, experience in injury coding and training level in injury coding.

resultsThe total number of different AIS codes used to describe 14 separate injuries in the three cases was 89. Mean accuracy per AIS code was 42.2% (range 2.4-92.7%). Mean accuracy on number of AIS codes was 23%. Overall inter-rater agreement per AIS code was 49.1% (range 2.4-92.7%). The number of assigned AIS codes varied between 0 and 18 per injury. Twenty-seven percentage of injuries were overlooked. ISS was correctly scored in 42.4%. In 31.7%, the AIS coding of the two more complex cases led to incorrect classification of the patient as ISS < 16 or ISS ≥ 16. Half (47%) of the coders had no (para)medical degree, 26% were working in level I trauma centers, 37% had less than 2 years of experience and 40% had no training in AIS coding.

conclusionsAccuracy of and inter-rater agreement on AIS injury scoring by DTR coders is limited. This may in part be due to the heterogeneous backgrounds and training levels of the coders. As a result of the inconsistent coding, the number of major trauma patients in the DTR may be over- or underestimated. Conclusions based on DTR data should therefore be drawn with caution.

Indexed as

Clinical CodingHumansInjury Severity ScoreNetherlandsRegistriesReproducibility of ResultsTrauma CentersWounds and Injuriesabbreviated injury scaleinjury severityquality improvementreliabilitytrauma registry

Identifiers

PMID33693687
PMCPMC7948386
OpenAlexW3135369962

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.