Machine learning models for predicting neonatal bacterial infections: a retrospective cohort study.

Bacterial infections represent a critical threat to neonatal health, accounting for approximately 25% of neonatal mortality globally. Timely and precise diagnosis in infants aged 1 to 90 days is essential to facilitate rapid intervention and prevent severe complications. This study aimed to develop and evaluate machine learning (ML) models for the early, non-invasive prediction of bacterial infections using routine clinical data, maximizing clinical interpretability for point-of-care triage. Data from 306 infants aged 1 to 90 days hospitalized between January 2014 and December 2022 at a Social Security Organization hospital in Khorasan Razavi, Iran, were retrospectively analyzed. The target variable was strictly labeled using cerebrospinal fluid (CSF) culture via lumbar puncture (LP) as the definitive gold standard (n = 158 infectious, 51.6%; n = 148 non-infectious, 48.4%). Predictors were limited to routine, non-invasive paraclinical markers extracted from the electronic health record and normalized using a QuantileTransformer pipeline. Nine ML classifiers were rigorously evaluated via a leakage-safe nested cross-validation (NCV) framework (5-folds × 2 repeats outer, threefold inner). Algorithmic behavior was decoded globally and locally using SHapley Additive exPlanations (SHAP) values, and overfitting was monitored via comprehensive training-to-validation generalization audits. Top-tier models clustered within an outer-CV AUROC range of 0.74-0.76. While non-linear gradient boosting (HistGBM) achieved the highest raw discrimination (AUROC = 0.786, 95% CI: 0.757-0.812), a generalization audit revealed a severe training optimism gap (0.214). Conversely, L