Evidence map›Paper›PMID 42087699›Full record

ArticleEmergency medicine Australasia : EMA2026

Optimising Retraining Frequency for a Paediatric Emergency Department Admission Prediction Model: Development and Temporal Validation Using Real-World Data.

Ethan Williams, Toshi Sinha, Mark Lyttle, Yogesan Kanagasingam

Abstract read
In one paragraph

Article in Emergency medicine Australasia : EMA, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Ethan WilliamsPerth Children's Hospital Emergency Department, Nedlands, Australia.ORCID 0009-0003-7278-0739
Toshi SinhaPerth Children's Hospital Emergency Department, Nedlands, Australia.ORCID 0000-0001-6481-8969
Mark LyttlePerth Children's Hospital Emergency Department, Nedlands, Australia.
Yogesan KanagasingamThe University of Notre Dame Australia, School of Medicine, Fremantle, Australia.

Funding

Australian Government Research Training ProgramNoton Dale Medical Research Scholarship
6 · The paper itself

Abstract

objectiveTo analyse temporal performance drift and optimal retraining frequency for an ensemble machine learning model to predict inpatient admission from paediatric emergency department (ED) triage data.

methodsThis study utilised 409,307 ED presentations from 1 July 2018 to 30 June 2024 at Perth Children's Hospital. An ensemble stacking model (XGBoost, TabNet, multi-layer perceptron and logistic regression base learners with a logistic regression meta-learner) incorporated structured triage features and tuned BioClinicalBERT-derived embeddings from free-text notes. The model ran prospectively through a 5-year rolling-window simulation, testing nine retraining cadences from weekly to triennial and a static model. Training, retraining and validation datasets were temporally separate and prior to the test set. Primary outcomes were discrimination via the area under the receiver operator characteristic (AUROC) and calibration as absolute mean daily bed error (AMDBE).

resultsWeekly retraining achieved a mean AUROC of 0.843 (SD 0.016) and AMDBE of 2.57 (SD 1.79) over the 5-year simulation. Fortnightly and monthly cadences were non-inferior (AMDBE 2.61 and 2.73), whereas longer intervals showed progressive calibration degradation (p < 0.001) and stable AUROC. Concept drift was most pronounced in the static model, with a mean AMDBE of 10.6 in 2024 compared to 1.79 for the weekly model. Notably, monthly retraining required only 25% of the weekly computational burden with non-inferior performance.

conclusionMonthly, or more frequent, model retraining sustains discrimination and calibration for paediatric ED admission prediction. This effectively mitigated concept drift and enabled accurate simulated daily bed-demand forecasting, providing evidence to support the clinical testing of such modelling.

Indexed as

Emergency Service, HospitalMachine LearningPatient AdmissionTriageChildEmergency Room VisitsHumansLogistic ModelsPediatricsPrediction AlgorithmsPredictive Learning ModelsROC Curveadmission predictionartificial intelligenceconcept driftmachine learningpaediatric emergency medicine

Identifiers

PMID42087699
PMCPMC13146150

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.