Evidence map›Paper›PMID 37775256›Full record

Observational studyEmergency medicine journal : EMJ2023

Detection of patients with COVID-19 by the emergency medical services in Lombardy through an operator-based interview and machine learning models.

Stefano Spina, Lorenzo Gianquintieri, Francesco Marrazzo, Maurizio Migliari, Giuseppe Maria Sechi, Maurizio Migliori, Andrea Pagliosa, Rodolfo Bonora, Thomas Langer, Enrico Gianluca Caiani and 2 more

Open access · hybridAbstract readObservational Study
In one paragraph

Observational study in Emergency medicine journal : EMJ, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
0.9field-weighted citation impact, top 24% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 4 citations in OpenAlex.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 3 institutions in 1 country.

Stefano Spina *SOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.ORCID http://orcid.org/0000-0003-3210-1714
Lorenzo Gianquintieri *SOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.
Francesco Marrazzo *SOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.
Maurizio MigliariSOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.
Giuseppe Maria SechiSOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.
Maurizio MiglioriSOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.
Andrea PagliosaSOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.
Rodolfo BonoraSOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy.
Thomas LangerDepartment of Anesthesia, Critical Care and Pain Medicine, ASST Grande Ospedale Metropolitano Niguarda, Milano, Italy.
Enrico Gianluca CaianiElectronics, Information and Biomedical Engineering Department, Politecnico di Milano, Milano, Italy.
Roberto FumagalliSOREU, Agenzia Regionale Emergenza Urgenza (AREU), Milano, Italy roberto.fumagalli@unimib.it.ORCID http://orcid.org/0000-0003-0398-1329
AREU 118 EMS Network Collaborators
Agenzia Regionale Emergenza Urgenza · ITAzienda Socio Sanitaria Territoriale Grande Ospedale Metropolitano Niguarda · ITPolitecnico di Milano · IT

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe regional emergency medical service (EMS) in Lombardy (Italy) developed clinical algorithms based on operator-based interviews to detect patients with COVID-19 and refer them to the most appropriate hospitals. Machine learning (ML)-based models using additional clinical and geospatial epidemiological data may improve the identification of infected patients and guide EMS in detecting COVID-19 cases before confirmation with SARS-CoV-2 reverse transcriptase PCR (rtPCR).

methodsThis was an observational, retrospective cohort study using data from October 2020 to July 2021 (training set) and October 2021 to December 2021 (validation set) from patients who underwent a SARS-CoV-2 rtPCR test within 7 days of an EMS call. The performance of an operator-based interview using close contact history and signs/symptoms of COVID-19 was assessed in the training set for its ability to determine which patients had an rtPCR in the 7 days before or after the call. The interview accuracy was compared with four supervised ML models to predict positivity for SARS-CoV-2 within 7 days using readily available prehospital data retrieved from both training and validation sets.

resultsThe training set includes 264 976 patients, median age 74 (IQR 55-84). Test characteristics for the detection of COVID-19-positive patients of the operator-based interview were: sensitivity 85.5%, specificity 58.7%, positive predictive value (PPV) 37.5% and negative predictive value (NPV) 93.3%. Contact history, fever and cough showed the highest association with SARS-CoV-2 infection. In the validation set (103 336 patients, median age 73 (IQR 50-84)), the best-performing ML model had an AUC of 0.85 (95% CI 0.84 to 0.86), sensitivity 91.4% (95 CI% 0.91 to 0.92), specificity 44.2% (95% CI 0.44 to 0.45) and accuracy 85% (95% CI 0.84 to 0.85). PPV and NPV were 13.3% (95% CI 0.13 to 0.14) and 98.2% (95% CI 0.98 to 0.98), respectively. Contact history, fever, call geographical distribution and cough were the most important variables in determining the outcome.

conclusionML-based models might help EMS identify patients with SARS-CoV-2 infection, and in guiding EMS allocation of hospital resources based on prespecified criteria.

Indexed as

COVID-19Emergency Medical ServicesAgedCoughHumansMachine LearningRetrospective StudiesSARS-CoV-2Sensitivity and SpecificityCOVID-19emergency ambulance systemsmachine learningpre-hospital care

Identifiers

PMID37775256
PMCPMC10715549
OpenAlexW4387168228

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.