Evidence map›Paper›PMID 34983764›Full record

Observational studyBMJ open2022

Using machine learning to predict blood culture outcomes in the emergency department: a single-centre, retrospective, observational study.

Anneroos W Boerman, Michiel Schinkel, Lotta Meijerink, Eva S van den Ende, Lara Ca Pladet, Martijn G Scholtemeijer, Joost Zeeuw, Anuschka Y van der Zaag, Tanca C Minderhoud, Paul W G Elbers and 4 more

Registry-linked trialOpen access · goldAbstract readObservational Study
In one paragraph

Observational study in BMJ open, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06163781 (Appropriate Use of Blood Cultures in the Emergency Department Through Machine Learning), which is not on this map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
4.6field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06163781 narecruitingnot on this mapstarted 2024, after this paper: background citation

Appropriate Use of Blood Cultures in the Emergency Department Through Machine Learning: a Randomized Controlled Trial

TypeinterventionalSponsorAmsterdam UMC, location VUmcRan2024 to 2027Enrolled7,584ConditionsArtificial Intelligence, Machine Learning, Microbiology, Emergency Service, HospitalArmsBlood culture prediction tool
3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it, 33 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 4 institutions in 3 countries.

Anneroos W Boerman *Section General and Acute Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
Michiel Schinkel *Section General and Acute Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
Lotta MeijerinkPacmed, Amsterdam, The Netherlands.
Eva S van den EndeSection General and Acute Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
Lara Ca PladetSection General and Acute Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
Martijn G ScholtemeijerPacmed, Amsterdam, The Netherlands.
Joost ZeeuwPacmed, Amsterdam, The Netherlands.
Anuschka Y van der ZaagSection General and Acute Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
Tanca C MinderhoudSection General and Acute Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
Paul W G ElbersDepartment of Intensive Care Medicine, Amsterdam Medical Data Science, Amsterdam Cardiovascular Science, Amsterdam Infection and Immunity Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
W Joost WiersingaCenter for Experimental and Molecular Medicine, Amsterdam UMC Location AMC, Amsterdam, The Netherlands.
Robert de JongeDepartment of Clinical Chemistry, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
Mark Hh KramerBoard of Directors, Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands.
Prabath W B NanayakkaraSection General and Acute Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands p.nanayakkara@amsterdamumc.nl.ORCID 0000-0002-1555-3682
Amsterdam Neuroscience · NLAmsterdam University Medical Centers · NLCenter for Molecular Medicine and Immunology · USInstitute of Directors · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo develop predictive models for blood culture (BC) outcomes in an emergency department (ED) setting.

designRetrospective observational study.

settingED of a large teaching hospital in the Netherlands between 1 September 2018 and 24 June 2020.

participantsAdult patients from whom BCs were collected in the ED. Data of demographic information, vital signs, administered medications in the ED and laboratory and radiology results were extracted from the electronic health record, if available at the end of the ED visits.

main outcome measuresThe primary outcome was the performance of two models (logistic regression and gradient boosted trees) to predict bacteraemia in ED patients, defined as at least one true positive BC collected at the ED.

resultsIn 4885 out of 51 399 ED visits (9.5%), BCs were collected. In 598/4885 (12.2%) visits, at least one of the BCs was true positive. Both a gradient boosted tree model and a logistic regression model showed good performance in predicting BC results with area under curve of the receiver operating characteristics of 0.77 (95% CI 0.73 to 0.82) and 0.78 (95% CI 0.73 to 0.82) in the test sets, respectively. In the gradient boosted tree model, the optimal threshold would predict 69% of BCs in the test set to be negative, with a negative predictive value of over 94%.

conclusionsBoth models can accurately identify patients with low risk of bacteraemia at the ED in this single-centre setting and may be useful to reduce unnecessary BCs and associated healthcare costs. Further studies are necessary for validation and to investigate the potential clinical benefits and possible risks after implementation.

Indexed as

Blood CultureEmergency Service, HospitalAdultHumansLogistic ModelsMachine LearningRetrospective Studiesaccident & emergency medicinediagnostic microbiologyinternal medicine

Identifiers

PMID34983764
PMCPMC8728456
OpenAlexW4205775747

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.