Evidence map›Paper›PMID 31615407›Full record

ArticleBMC emergency medicine2019

The reliability and accuracy of operational system data in a nationwide helicopter emergency medical services mission database.

A Heino, T Iirola, L Raatiniemi, J Nurmi, A Olkinuora, P Laukkanen-Nevala, I Virkkunen, M Tommila

Abstract read
In one paragraph

Article in BMC emergency medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Observational
  2. Observational
  3. Observational
  4. Article
  5. Article
  6. Article
  7. Variables required for the audit of quality completion of patient report forms by EMS-A scoping review.African journal of emergency medicine : Revue africaine de la medecine d'urgence · 2022
    Article
  8. Observational
  9. Observational
  10. Observational
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

A HeinoFinnHEMS Research and Development Unit, Vantaa, Finland. anssi.heino@tyks.fi.ORCID 0000-0002-5230-0166
T IirolaEmergency Medical Services, Turku University Hospital and University of Turku, Turku, Finland.
L RaatiniemiCentre for Pre-Hospital Emergency Medicine, Oulu University Hospital, Oulu, Finland.
J NurmiEmergency Medicine Services, Helsinki University Hospital and Department of Emergency Medicine, University of Helsinki, Helsinki, Finland.
A OlkinuoraFinnHEMS Research and Development Unit, Vantaa, Finland.
P Laukkanen-NevalaFinnHEMS Research and Development Unit, Vantaa, Finland.
I VirkkunenFinnHEMS Research and Development Unit, Vantaa, Finland.
M TommilaDepartment of Perioperative Services, Intensive Care Medicine and Pain Management, Turku University Hospital and University of Turku, Turku, Finland.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

aimThe aim of this study was to evaluate the reliability and accuracy of documentation in FinnHEMS database, which is a nationwide helicopter emergency service (HEMS) clinical quality registry.

methodsThis is a nationwide study based on written fictional clinical scenarios. Study subjects were HEMS physicians and paramedics, who filled in the clinical quality registry based on the clinical scenarios. The inter-rater -reliability of the collected data was analyzed with percent agreement and free-marginal multi-rater kappa.

resultsDispatch coding had a percent agreement of 91% and free-marginal multi-rater kappa value of 0.83. Coding for transportation or mission cancellation resulted in an agreement of 84% and free-marginal kappa value of 0.68. An agreement of 82% and a kappa value of 0.73 for dispatcher coding was found. Mission end, arrival at hospital and HEMS unit dispatch -times had agreements from 80 to 85% and kappa values from 0.61 to 0.73. The emergency call to dispatch centre time had an agreement of 71% and kappa value of 0.56. The documentation of pain had an agreement of 73% on both the first and second measurements. All other vital parameters had less than 70% agreement and 0.40 kappa value in the first measurement. The documentation of secondary vital parameter measurements resulted in agreements from 72 to 91% and kappa values from 0.43 to 0.64.

conclusionData from HEMS operations can be gathered reliably in a national clinical quality registry. This study revealed some inaccuracies in data registration and data quality, which are important to detect to improve the overall reliability and validity of the HEMS clinical quality register.

Indexed as

Air AmbulancesAirway ManagementClinical CodingDatabases, FactualDocumentationFemaleFinlandHumansMaleObserver VariationReproducibility of ResultsTime FactorsVital SignsClinical quality registryData reliabilityDocumentationHEMSPre-hospital

Identifiers

PMID31615407
PMCPMC6792230

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.