Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces a reactive control method for multi-objective tasks that uses nullspace projections within a graph-based world model to resolve conflicting objectives based on dynamically determined priorities. This approach overcomes limitations of static encodings that lead to local minima, enabling successful navigation around non-convex obstacles and planar pushing of non-convex objects. The method achieves 100% success in planar pushing simulations, outperforming steepest-descent and diffusion policy baselines, and transfers directly to a real robot.
Reactive control can achieve complex multi-objective behaviors previously thought impossible, simply by dynamically prioritizing and resolving conflicting objectives within a learned world model.
Reactive control is often considered insufficient for multi-objective tasks because conflicting objectives give rise to local minima. We argue this limitation is not inherent but arises from static encodings that fail to reflect how objectives currently interact. We exploit the interaction structure encoded in a graph-based world model by extending it with nullspace projections: conflicts are resolved where they arise by projecting lower-priority gradients into the nullspace of higher-priority ones, with priorities determined continuously from the current state. We demonstrate this in two domains where conflicts between objectives are central: navigation around non-convex obstacles, where static potential fields fundamentally fail, and planar pushing of non-convex objects, where our method achieves $100\%$ success across one-hundred configurations versus $0\%$ for the steepest-descent baseline and ${\sim}55\%$ for diffusion policy, without demonstrations or retraining. The same formulation transfers directly to a real robot with additional perceptual and kinematic constraints, accommodating them through the same mechanism.