Evidence map›Paper›PMID 35063009›Full record

Observational studyAntimicrobial resistance and infection control2022

Reliability and validity of multicentre surveillance of surgical site infections after colorectal surgery.

Janneke D M Verberk, Stephanie M van Rooden, David J Hetem, Herman F Wunderink, Anne L M Vlek, Corianne Meijer, Eva A H van Ravensbergen, Elisabeth G W Huijskens, Saara J Vainio, Marc J M Bonten and 1 more

Open access · goldAbstract readObservational Study
In one paragraph

Observational study in Antimicrobial resistance and infection control, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
2.0field-weighted citation impact, top 15% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 10 citations in OpenAlex.

  1. Trial
  2. Trial
  3. Article
  4. Observational
  5. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 7 institutions in 1 country.

Janneke D M VerberkDepartment of Medical Microbiology and Infection Prevention, University Medical Centre Utrecht, P.O. Box 85500, 3508 GA, Utrecht, The Netherlands. J.D.M.verberk-2@umcutrecht.nl.ORCID 0000-0003-2148-5935
Stephanie M van RoodenJulius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht, The Netherlands.
David J HetemDepartment of Medical Microbiology and Infection Prevention, Haaglanden Medical Centre, The Hague, the Netherlands.
Herman F WunderinkDepartment of Medical Microbiology and Infection Prevention, University Medical Centre Utrecht, P.O. Box 85500, 3508 GA, Utrecht, The Netherlands.
Anne L M VlekDepartment of Medical Microbiology and Immunology, Diakonessenhuis Utrecht, Utrecht, The Netherlands.
Corianne MeijerDepartment of Medical Microbiology, Radboud Centre for Infectious Diseases, Radboud University Medical Centre, Nijmegen, The Netherlands.
Eva A H van RavensbergenDepartment of Infection Prevention and Control, Alrijne Zorggroep, Leiderdorp, The Netherlands.
Elisabeth G W HuijskensDepartment of Medical Microbiology, Albert Schweitzer Hospital, Dordrecht, The Netherlands.
Saara J VainioDepartment of Medical Microbiology, Immunology and Infection Prevention, St.Antonius Hospital, Nieuwegein, The Netherlands.
Marc J M BontenDepartment of Medical Microbiology and Infection Prevention, University Medical Centre Utrecht, P.O. Box 85500, 3508 GA, Utrecht, The Netherlands.
Maaike S M van MourikDepartment of Medical Microbiology and Infection Prevention, University Medical Centre Utrecht, P.O. Box 85500, 3508 GA, Utrecht, The Netherlands.
University Medical Center Utrecht · NLAlbert Schweitzer Ziekenhuis · NLAlrijne Ziekenhuis · NLDiakonessenhuis hospital · NLMedisch Centrum Haaglanden · NLRadboud University Nijmegen · NLSt. Antonius Ziekenhuis · NL

Funding

Regional Healthcare Network Antibiotic Resistance Utrecht 327643
6 · The paper itself

Abstract

backgroundSurveillance is the cornerstone of surgical site infection prevention programs. The validity of the data collection and awareness of vulnerability to inter-rater variation is crucial for correct interpretation and use of surveillance data. The aim of this study was to investigate the reliability and validity of surgical site infection (SSI) surveillance after colorectal surgery in the Netherlands.

methodsIn this multicentre prospective observational study, seven Dutch hospitals performed SSI surveillance after colorectal surgeries performed in 2018 and/or 2019. When executing the surveillance, a local case assessment was performed to calculate the overall percentage agreement between raters within hospitals. Additionally, two case-vignette assessments were performed to estimate intra-rater and inter-rater reliability by calculating a weighted Cohen's Kappa and Fleiss' Kappa coefficient. To estimate the validity, answers of the two case-vignettes questionnaires were compared with the answers of an external medical panel.

results1111 colorectal surgeries were included in this study with an overall SSI incidence of 8.8% (n = 98). From the local case assessment it was estimated that the overall percent agreement between raters within a hospital was good (mean 95%, range 90-100%). The Cohen's Kappa estimated for the intra-rater reliability of case-vignette review varied from 0.73 to 1.00, indicating substantial to perfect agreement. The inter-rater reliability within hospitals showed more variation, with Kappa estimates ranging between 0.61 and 0.94. In total, 87.9% of the answers given by the raters were in accordance with the medical panel.

conclusionsThis study showed that raters were consistent in their SSI-ascertainment (good reliability), but improvements can be made regarding the accuracy (moderate validity). Accuracy of surveillance may be improved by providing regular training, adapting definitions to reduce subjectivity, and by supporting surveillance through automation.

Indexed as

Epidemiological MonitoringAdultAgedAged, 80 and overColorectal SurgeryFemaleHumansMaleMiddle AgedNetherlandsProspective StudiesReproducibility of ResultsSurgical Wound InfectionColorectal surgeryEpidemiologyInfection preventionInter-rater reliabilitySurgical site infectionSurveillance

Identifiers

PMID35063009
PMCPMC8780777
OpenAlexW4207020780

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.