Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces BRACE, a controller that optimizes the replanning process for embodied agents by implementing a budgeted control loop that manages replanning frequency, mode selection, and token allocation while considering latency service-level objectives. The method incorporates E-RECAP, a progressive token pruning technique that effectively reduces the token count during replanning by predicting token utility and maintaining essential tokens. Experimental results across multiple platforms show that BRACE with E-RECAP significantly decreases replanning token counts by 62-92% and reduces service-level objective violations from as high as 100% to as low as 4.7%, while maintaining high task success rates.
Replanning latency can be drastically reduced by 62-92% without sacrificing task success, thanks to a novel budgeted control loop approach.
Embodied agents replan frequently to recover from execution drift, partial observability, and coordination hazards, but each LLM-based replanning call can consume an accumulated textual context that grows over time and across agents. Once this context becomes large, replanning latency develops heavy tails and can miss real-time deadlines even when task success remains high, a failure mode that is hard to detect from average latency or success alone. We present BRACE, a controller that formulates replanning as a budgeted control loop by deciding whether to replan, selecting a replanning mode, and allocating an explicit token budget and latency service-level objective (SLO) while accounting for optional efficiency modules. As a reusable component, we introduce E-RECAP, a cost-aware progressive token pruning method that predicts token utility and prunes replanning contexts across transformer layers while preserving critical head and tail tokens. Across Meta Habitat, RoboFactory, and AirSim, BRACE with E-RECAP reduces replanning-call token counts by 62-92% and SLO violation rates from 85.5-100.0% to 4.7-50.0% in settings where task success is already saturated. In a harder RoboFactory setting where open-loop, frozen-plan, and No BRACE all fail, BRACE + E-RECAP reaches 80.0% success with 4.6% SLO violations, demonstrating that tail-aware per-call budgeting is effective across embodied platforms.