Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SNF-ICON, an innovative event-driven controller for job scheduling in high-performance computing (HPC) systems that optimizes energy efficiency by managing idle node counts. By integrating smallest-need-first gang scheduling with predictive wake timing and adaptive warm-spare control, SNF-ICON effectively reduces average waiting times compared to traditional scheduling methods like First Come First Served (FCFS) with backfilling. The evaluation across multiple workloads demonstrates that SNF-ICON consistently outperforms FCFS in waiting time while maintaining energy efficiency, highlighting the importance of adaptive scheduling strategies in HPC environments.
SNF-ICON cuts average waiting times in HPC job scheduling while optimizing energy use, proving that smarter scheduling can significantly enhance performance.
Power-state management in high-performance computing (HPC) clusters must reduce idle energy without excessive wake-up delays for rigid parallel jobs. This paper presents SNF-ICON, an event-driven controller combining smallest-need-first (SNF) gang scheduling, predictive wake timing, and adaptive warm-spare control. At each scheduler invocation, recent interarrival and completed-service samples are screened for sufficiency, exponential-like variability, low lag-one autocorrelation, and acceptable Kolmogorov-Smirnov distance. Rejected or data-sparse windows use SNF+IPM (Intelligent Power Manager), whereas accepted windows activate release prediction and an exponential next-event model. Warm-spare optimization is applied only when queue, event, and arrival-recency conditions permit, balancing estimated waiting and non-compute energy over a timeout-capped horizon. We evaluate four DAS2 trace segments and a generated Markovian workload on AOBA-derived 64-node models, plus SDSC Blue on an AOBA-derived 1152-node model. SNF-ICON is compared with SNF+IPM and First Come First Served (FCFS) + backfilling with IPM. It reduces average waiting time relative to the FCFS-based baseline in all six cases and remains close to at least one heuristic energy baseline in five. The generated workload spends substantial time in ICON mode, whereas DAS2 workloads operate mainly in fallback. Furthermore, cross-platform results show strong dependence on node-transition and power models. Thus, no single policy or parameter set works best in every case.