Evidence map›Paper›PMID 29197376›Full record

ArticleBMC health services research2017

Development and testing of the KERNset: an instrument to assess the quality of telephone triage in out-of-hours primary care services.

Marleen Smits, Ellen Keizer, Paul Ram, Paul Giesen

Abstract read
In one paragraph

Article in BMC health services research, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Observational
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Marleen SmitsRadboud University Medical Center, Radboud Institute for Health Sciences, Scientific Center for Quality of Healthcare (IQ healthcare), P.O Box 9101, 114 IQ healthcare, 6500, HB, Nijmegen, The Netherlands. marleen.smits@radboudumc.nl.ORCID http://orcid.org/0000-0001-9073-5382
Ellen KeizerRadboud University Medical Center, Radboud Institute for Health Sciences, Scientific Center for Quality of Healthcare (IQ healthcare), P.O Box 9101, 114 IQ healthcare, 6500, HB, Nijmegen, The Netherlands.
Paul RamMaastricht University, Faculty of Health Medicine and Life Sciences, Maastricht, The Netherlands.
Paul GiesenRadboud University Medical Center, Radboud Institute for Health Sciences, Scientific Center for Quality of Healthcare (IQ healthcare), P.O Box 9101, 114 IQ healthcare, 6500, HB, Nijmegen, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundTelephone triage is a core but vulnerable part of the care process at out-of-hours general practitioner (GP) cooperatives. In the Netherlands, different instruments have been used for assessing the quality of telephone triage. These instruments focussed mainly on communicational aspects, and less on the medical quality of triage decisions. Our aim was to develop and test a minimum set of items to assess the quality of telephone triage.

methodsA national survey among all GP cooperatives in the Netherlands was performed to examine the most important aspects of telephone triage. Next, corresponding items from existing instruments were searched on these topics. Subsequently, an expert panel judged these items on importance, completeness and formulation. The concept KERNset consisted of 24 items about the telephone conversation: 13 medical, ten communicational and one regarding both types. It was pilot tested on measurement characteristics, reliability, validity and variation between triagists. In this pilot study, 114 anonymous calls from four GP cooperatives spread across the Netherlands were judged by three out of eight raters, both internal and external raters.

resultsCronbach's alpha was .94 for the medical items and .75 for the communicational items. Inter-rater reliability: complete agreement between the external raters was 45% and reasonable agreement 73% (difference of maximally one point on the five-point scale). Intra-rater reliability: complete agreement within raters was 55% and reasonable agreement 84%. There were hardly any differences between internal and external raters, but there were differences in strictness between individual raters. The construct validity was confirmed by the high correlation between the general impression of the call and the items of the KERNset. Of the differences within items 19% could be explained by differences between triage nurses, which means the KERNset is able to demonstrate differences between triage nurses.

conclusionsThe KERNset can be used to assess the quality of telephone triage. The validity is good and differences between calls and between triage nurses can be measured. A more intensive training for raters could improve the reliability.

Indexed as

TelephoneAfter-Hours CareCommunicationHumansNetherlandsObserver VariationPilot ProjectsPrimary Health CareQuality Assurance, Health CareSurveys and QuestionnairesTriageAfter-hoursInstrumentPrimary careQualityTriage

Identifiers

PMID29197376
PMCPMC5712191

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.