Evidence map›Paper›PMID 34583698›Full record

ArticleBMC health services research2021

Challenges to ensuring valid and useful waiting time monitoring - a qualitative study in Swedish specialist care.

David Ebbevi, Henna Hasson, Knut Lönnroth, Hanna Augustsson

Open access · goldAbstract read
In one paragraph

Article in BMC health services research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
2.5field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 10 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 1 country.

David EbbeviUnit for implementation and evaluation, Center for Epidemiology and Community Medicine Stockholm Regional Council, Stockholm, Sweden. david.ebbevi@sll.se.
Henna HassonUnit for implementation and evaluation, Center for Epidemiology and Community Medicine Stockholm Regional Council, Stockholm, Sweden.
Knut LönnrothUnit for implementation and evaluation, Center for Epidemiology and Community Medicine Stockholm Regional Council, Stockholm, Sweden.
Hanna AugustssonUnit for implementation and evaluation, Center for Epidemiology and Community Medicine Stockholm Regional Council, Stockholm, Sweden.
Stockholm County Council · SEKarolinska Institutet · SE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAccess to health care is an essential health policy issue. In several countries, waiting time guarantees mandate set time limits for assessment and treatment. High-quality waiting time data are necessary to evaluate and improve waiting times. This study's aim was to investigate health care providers and administrative management professionals' perceptions of validity and usefulness of waiting time reporting in specialist care.

methodsSemi-structured interviews (n = 28) were conducted with administrative management and care professionals (line managers and care providers) in specialized clinics in the Stockholm Region, Sweden. Clinic-specific data from the waiting time registry was used in the care provider interviews to assess face validity. Clinics were purposefully sampled for maximum variation in complexity of care, volume of production, geographical location, private or public ownership, and local waiting times. Thematic analysis was used.

resultsThe waiting time registry was perceived to have low validity and usefulness. Perceived validity and usefulness were interconnected, with mechanisms that reinforced the connection. Structural and cognitive barriers to validity included technical and procedural errors, errors caused by role division, misinterpretation of guidelines, diverging interpretations of nonregulated cases and extensive willful manipulation of data.

conclusionsWe identify four misconceptions underpinning the current waiting time reporting system: passive dissemination of guidelines is sufficient as implemented, cognitive load of care providers to report waiting times is negligible, soft-law regulation and presentation of outcome data is sufficient to drive improvement, and self-reported data linked to incentives poses a low risk of data corruption. To counter low validity and usefulness, we propose the following for policy makers and administrative management when developing and implementing waiting time monitoring: communicate guidelines with instructions for operationalization, address barriers to implementation, ensure quality through monitoring of implementation and adherence to guidelines, develop IT ontology together with professionals, avoid parallel measurement infrastructures, ensure waiting times are presented to suit management needs, provide timely waiting time data, enable the study of single cases, minimize manual data entry, and perform spot-checks or external validity checks. Several of these strategies should be transferable to waiting time monitoring in other contexts.

Indexed as

Health PersonnelWaiting ListsDelivery of Health CareHumansQualitative ResearchSwedenAccessHealth policyHealth system quality and safetyMeasurementQuality registryWaiting times

Identifiers

PMID34583698
PMCPMC8478272
OpenAlexW3204008544

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.