Search papers, labs, and topics across Lattice.
This paper introduces Closed-Loop Affine Activation Editing (CLAE), an innovative framework that allows for real-time steering of a frozen multi-robot policy without retraining, thus avoiding the pitfalls of catastrophic forgetting. By utilizing a sparse autoencoder to analyze and edit intermediate activations based on the robot's state and environment, CLAE effectively adapts individual and multi-robot behaviors during inference. Experimental results demonstrate CLAE's capability to control velocity profiles, maintain formations, and even generate novel behaviors, such as evading surveillance, showcasing its versatility in dynamic environments.
CLAE enables real-time behavior adaptation in robots without retraining, allowing for unprecedented flexibility in dynamic environments.
Real-world robots need to adapt their behavior beyond the envelope of their pre-trained policy. Policy finetuning or retraining are options, but they risk catastrophic forgetting, degrading the pretrained policy's base performance. To combat this, we introduce CLAE: Closed-Loop Affine Activation Editing, an inference-time framework for steering the behavior of a frozen policy by editing intermediate activations while keeping the base policy weights and downstream action head untouched. CLAE approaches behavior steering as a closed-loop problem whose outputs edit policy activations that adapt online to the robot state, environment, target behavior, and multi-robot context. It trains a sparse autoencoder over frozen-policy activations, selects behavior-relevant latent features via post-hoc probing, and learns a lightweight RL-based steering policy that applies state-dependent affine edits to selected latents during inference. We validate CLAE on a frozen multi-quadrotor navigation policy trained to perform a single task: navigating robots to a set of goal locations while avoiding obstacles. Through extensive simulations and physical tests, we show that while navigating to their goal positions, CLAE can 1. steer individual robot behavior by controlling each robot's velocity profile; 2. coordinate multirobot behavior by preserving a desired formation; and 3. produce entirely new behavior wherein robots are required to reduce their exposure to surveillance cameras in the environment.
