Evidence map›Paper›PMID 32853217›Full record

ArticlePloS one2020

Man vs. machine: Predicting hospital bed demand from an emergency department.

Filipe Rissieri Lucini, Mateus Augusto Dos Reis, Giovani José Caetano da Silveira, Flavio Sanson Fogliatto, Michel José Anzanello, Giordanna Guerra Andrioli, Rafael Nicolaidis, Rafael Coimbra Ferreira Beltrame, Jeruza Lavanholi Neyeloff, Beatriz D'Agord Schaan

Abstract read
In one paragraph

Article in PloS one, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Filipe Rissieri LuciniDepartment of Critical Care Medicine, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.ORCID 0000-0002-6090-6846
Mateus Augusto Dos ReisHospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.ORCID 0000-0003-0510-4506
Giovani José Caetano da SilveiraHaskayne School of Business, University of Calgary, Calgary, AB, Canada.ORCID 0000-0001-6960-955X
Flavio Sanson FogliattoIndustrial Engineering Department, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
Michel José AnzanelloIndustrial Engineering Department, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
Giordanna Guerra AndrioliHospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
Rafael NicolaidisHospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
Rafael Coimbra Ferreira BeltrameHospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
Jeruza Lavanholi NeyeloffHospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
Beatriz D'Agord SchaanHospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe recent literature reports promising results from using intelligent systems to support decision making in healthcare operations. Using these systems may lead to improved diagnostic and treatment protocols and to predict hospital bed demand. Predicting hospital bed demand in emergency department (ED) attendances could help resource allocation and reduce pressure on busy hospitals. However, there is still limited knowledge on whether intelligent systems can operate as fully autonomous, user-independent systems.

objectiveCompare the performance of a computer-based algorithm and humans in predicting hospital bed demand (admissions and discharges) based on the initial SOAP (Subjective, Objective, Assessment, Plan) records of the ED.

methodsThis was a retrospective cohort study that compared the performance of humans and machines in predicting hospital bed demand from an ED. It considered electronic medical records (EMR) of 9030 patients (230 used as a testing set, and hence evaluated both by humans and by an algorithm, and 8800 used as a training set exclusively by the algorithm) who visited the ED of a tertiary care and teaching public hospital located in Porto Alegre, Brazil between January and December 2014. The machine role was played by Support Vector Machine Classifier and the human prediction was performed by four ED physicians. Predictions were compared in terms of sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUROC).

resultsAll graders achieved similar accuracies. The accuracy by AUROC for the testing set was 0.82 [95% confidence interval (CI) of 0.77-0.87], 0.80 (95% CI: 0.75-0.85), 0.76 (95% CI: 0.71-0.81) for novice physicians, machine, experienced physicians, respectively. Processing time per test EMR was 0.00812±0.0009 seconds. In contrast, novice physicians took on average 156.80 seconds per test EMR, while experienced physicians took on average 56.40 seconds per test EMR.

conclusionsOur data indicated that the system could predict patient admission or discharge states with 80% accuracy, which was similar the performance of novice and experienced physicians. These results suggested that the algorithm could operate as an autonomous and independent system to complete this task.

Indexed as

Emergency Service, HospitalHealth Services Needs and DemandHospital Bed CapacityArea Under CurveDatabases as TopicHumansROC CurveSurveys and Questionnaires

Identifiers

PMID32853217
PMCPMC7451657

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.