Search papers, labs, and topics across Lattice.
The paper introduces ScaleBox, a code verification system designed to improve the accuracy and efficiency of evaluating and training LLMs on code. ScaleBox achieves this through automated special-judge generation, fine-grained parallel execution of test cases, and a configuration-driven evaluation suite. Experiments demonstrate that ScaleBox enhances code verification accuracy and efficiency, leading to improved performance and training stability in RLVR experiments compared to heuristic baselines.
LLMs trained with ScaleBox, a new high-fidelity code verification system, substantially outperform those trained with heuristic matching, suggesting current RLHF methods are bottlenecked by verification quality.
Code sandboxes have emerged as a critical infrastructure for advancing the coding capabilities of large language models, providing verifiable feedback for both RL training and evaluation. However, existing systems fail to provide accurate verification and efficiency under high-concurrency workloads. We present ScaleBox, a high-fidelity and scalable system designed to address these limitations in large-scale code training. ScaleBox introduces automated special-judge generation and management, fine-grained parallel execution across test cases with seamless multi-node coordination, and a configuration-driven evaluation suite for reproducible benchmarking. A series of experiments demonstrates that ScaleBox significantly enhances code verification accuracy and efficiency. Our further RLVR experiments show that ScaleBox substantially improves both performance on LiveCodeBench and training stability, significantly outperforming heuristic-matching baselines. By providing a reliable and high-throughput infrastructure, ScaleBox facilitates more effective research and development in large-scale code training.
