Evidence map›Paper›PMID 17074874›Full record

ArticleQuality & safety in health care2006

Do panels vary when assessing intrapartum adverse events? The reproducibility of assessments by hospital risk management groups.

D Kernaghan, G C Penney

Abstract readValidation Study
In one paragraph

Article in Quality & safety in health care, 2006. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

D KernaghanScottish Programme for Clinical Effectiveness in Reproductive Health, Department of Obstetrics and Gynaecology, Simpson Centre for Reproductive Health, Edinburgh, UK. dawn.kernaghan@ed.ac.uk
G C Penney

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionA national audit project, Scotland-wide Learning from Intrapartum Critical Events (SLICE), included local assessment of quality of care in cases of perinatal death and neonatal encephalopathy due to intrapartum events. Concerns had been raised about interobserver variation in case assessment by different panels. We therefore studied the extent of agreement and disagreement between assessment panels, and examined the areas in which agreement and disagreement tended to occur.

methods8 cases were randomly selected from all 42 cases identified during a 6-month period (1 January-1 July 2005). Each case was independently reviewed by three panels: the local hospital clinical risk-management group and two specially convened external panels. Panels assessed quality of care in three areas: admission assessment, recognition of incident, and method and timing of delivery. Predefined standards of care were provided for these three areas. Panels were also asked to assess the overall quality of care.

resultsFor each area of care, agreement between the two external panels was lowest. The lowest levels of agreement between panels were seen in assessment of overall care (50% crude agreement between external panel 1 and the hospital (kappa = 0.24, AC(1) = 0.36); 29% crude agreement between external panels 1 and 2 (kappa = -0.11, AC(1) = 0.1); 47% crude agreement between external panel 2 and the hospital (kappa = 0.36, AC(1) = 0.46). The lowest level of agreement among all three panels was also in the assessment of overall care (crude agreement 48%; kappa = 0.16, AC(1) = 0.34).

conclusionModerate to substantial agreement among the three panels was achieved for the three areas in which explicit standards were provided. Therefore, a systematic approach to analysis of adverse events in perinatal care improves reproducibility.

Indexed as

Infant MortalityRisk AssessmentRisk ManagementConsensusDelivery, ObstetricFemaleHumansInfant, NewbornMaleMedical AuditObserver VariationObstetric Labor ComplicationsPeer Review, Health CarePerinatal CarePregnancyScotland

Identifiers

PMID17074874
PMCPMC2565823

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.