Search papers, labs, and topics across Lattice.
This study systematically investigates the effectiveness of inference-time scaling in local computer-use agents (CUAs) under hardware constraints, focusing on various scaling dimensions such as contextual, temporal, structural, and parallel. The evaluation of models like Qwen3-VL-8B/30B-A3B and UI-TARS-1.5-7B on the OSWorld benchmark reveals that while additional computation can enhance performance, it often leads to diminishing returns and shifts in failure modes, particularly as contextual scaling saturates and temporal scaling fails to improve task success. The findings emphasize the need for efficient compute allocation and failure-aware mechanisms in the design of local CUAs to optimize their performance.
Diminishing returns in inference-time scaling reveal that more computation doesn't always equate to better performance in local computer-use agents.
Deploying autonomous computer-use agents (CUAs) locally is increasingly important for privacy, cost efficiency, and practical usability, yet improving their performance under strict hardware constraints remains challenging. While recent studies show that inference-time scaling can improve frontier computer-use agents through additional computation during execution, its effectiveness for resource-constrained local models remains poorly understood. We present a systematic empirical study of inference-time scaling in local CUAs across contextual, temporal, structural, and parallel dimensions. We evaluate Qwen3-VL-8B/30B-A3B, UI-TARS-1.5-7B, and OpenCUA-7B on the OSWorld benchmark. Our results show that additional computation often yields diminishing returns while changing failure modes. Contextual scaling provides historical grounding that improves trajectory stability and task accuracy, but its gains saturate as token cost increases and failures shift from repetitive or stalled trajectories toward premature false successes. Temporal scaling similarly reduces max-step stalls, yet does not substantially improve task success, indicating that longer horizons often extend erroneous trajectories rather than correct them. We further find that structural decomposition can introduce planning and formatting overhead in local two-stage agents, while parallel scaling partially mitigates these failures at a substantial computational cost. Overall, our findings suggest that efficient local CUAs require selective compute allocation, failure-aware control mechanisms, and agentic frameworks designed around the capabilities and limitations of local models.
