BUDS: Benchmark Uncertainty Design Selection for Two-Stage Single-Arm Phase II Trials.

Background: Simon two-stage designs for binary endpoints and their time-to-event analogues, including the restricted-Kwak and Jung method, rely on a fixed historical benchmark. In practice, historical benchmarks are often uncertain due to small samples, population heterogeneity, changing eligibility criteria, and evolving standards of care. When the clinically relevant benchmark exceeds the value used to calibrate the design, Type I error rates can be substantially inflated, leading to costly advancement of ineffective treatments. Existing design-selection criteria generally optimize efficiency at a single benchmark without accounting for this uncertainty. Methods: We propose Benchmark Uncertainty Design Selection (BUDS), a framework for selecting two-stage designs for both binary and time-to-event (TTE) endpoints. Rather than relying on a single planning benchmark, BUDS addresses benchmark uncertainty by specifying a plausible range of response rates for binary endpoints or survival probabilities at a prespecified timepoint for TTE endpoints. Among feasible designs that satisfy both Type I error ( Results: Across representative scenarios, the Type I error rate increases substantially when true benchmarks exceed their planning values using single-benchmark objectives, reaching 0.407 for Simon Optimal design (response rates: 0.10 vs. 0.15; Conclusions: BUDS provides a transparent framework for selecting designs when historical benchmarks are uncertain. It makes the trade-off between robustness and efficiency explicit while controlling Type I error across the plausible benchmark range. The framework applies to both binary and time-to-event endpoints in two-stage single-arm Phase II trial planning and is implemented in the open-source