Evidence map›Paper›PMID 30616535›Full record

ArticleBMC medical research methodology2019

Providing quality data in health care - almost perfect inter-rater agreement in the Norwegian tonsil surgery register.

Siri Wennberg, Lasse A Karlsen, Joacim Stalfors, Mette Bratt, Vegard Bugten

Abstract read
In one paragraph

Article in BMC medical research methodology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Digital Health Data Quality Issues: Systematic Review.Journal of medical Internet research · 2023
    Pooled it
  2. Development and validation of a machine learning model predicting post-tonsillectomy hemorrhage.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  3. Article
  4. A validation study of the 30-day questionnaire in the national Norwegian Tonsil Surgery Register: can we trust the data reported by the patients?European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2024
    Article
  5. Validation of the Swedish Quality Register for Ear Surgery - SwedEar.BMC medical informatics and decision making · 2023
    Article
  6. Article
  7. Article
  8. Observational
  9. Article
  10. Homogeneity score test of ACBMC medical research methodology · 2020
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Siri WennbergDepartment of Medical Quality Registries, St. Olav's University Hospital, MTFS, Torgarden, P.O. Box 3250, 7006, Trondheim, Norway. Siri.wennberg@stolav.no.ORCID 0000-0003-1634-584X
Lasse A KarlsenDepartment of Medical Quality Registries, St. Olav's University Hospital, MTFS, Torgarden, P.O. Box 3250, 7006, Trondheim, Norway.
Joacim StalforsSheikh Khalifa Medical City, Ajman, United Arab Emirates.
Mette BrattDepartment of Otorhinolaryngology, Head and Neck Surgery, St. Olav's University Hospital, Sluppen, P.O. Box 3250, 7006, Trondheim, Norway.
Vegard BugtenDepartment of Medical Quality Registries, St. Olav's University Hospital, MTFS, Torgarden, P.O. Box 3250, 7006, Trondheim, Norway.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe Norwegian Tonsil Surgery Register (NTSR) was launched in January 2017. The purpose of the register is to present data on tonsil surgery to facilitate improvements in patient care. Data used for evaluating the quality of medical care needs to be of high reliability. This study aims to assess the inter-rater reliability (IRR) of the variables reported to the register by medical professionals.

methodsThe study population consists of the first 137 tonsil surgery patients who were included in the NTSR at St. Olav's University Hospital in Trondheim. An experienced rater completed the register's paper form for all 137 patients based on their electronic medical records, blinded for the data already in the register. To assess the inter-rater reliability between the register and the external rater, we calculated observed agreement, Cohen's kappa and Gwet's AC

resultsAll tested variables in the NTSR have almost perfect reliability except for the variable for the cold steel technique, which had a substantial to almost perfect reliability. The inter-rater agreement was substantial to almost perfect for every variable, with substantial (kappa/AC

conclusionThis study shows that the reliability of the NTSR is high for all variables registered by the professionals at the hospital immediately after surgery.

Indexed as

Data AccuracyAdolescentAdultChildChild, PreschoolData CollectionFemaleHumansInfantMaleMiddle AgedObserver VariationPalatine TonsilRegistriesSurgical Procedures, OperativeTonsillectomyChronic tonsillitisData qualityMedical quality registerTonsillectomyTonsillotomyTonsil surgery

Identifiers

PMID30616535
PMCPMC6323706

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.