Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
PROMO addresses the challenge of balancing conflicting objectives in quadrupedal locomotion by introducing a preference-conditioned multi-objective reinforcement learning framework. This approach allows for explicit runtime control over objective trade-offs, separating operator intent from fixed locomotion priors. PROMO demonstrates broad Pareto coverage and predictable preference response, achieving significant improvements in objective specialization and robustness compared to traditional methods, and successfully transfers zero-shot to real-world hardware.
A single quadrupedal locomotion policy can dynamically adapt its gait and performance across stability, energy, and tracking objectives solely through runtime preference inputs, achieving up to 59% reduction in peak attitude deviation.
Quadrupedal locomotion requires balancing conflicting objectives such as command tracking, stability, and energy efficiency, yet conventional reinforcement learning (RL) hardcodes these priorities into a fixed scalar reward at training time. We present PROMO (Preference-Conditioned Multi-Objective Reinforcement Learning), a semantic multi-objective approach that makes this trade-off an explicit runtime input to a single locomotion policy. PROMO conditions the policy on deployment facing preferences while keeping embodiment-specific locomotion priors fixed, thereby separating operator intent from reward shaping terms required for viable gait generation. Compared with fixed-objective controllers, multi-objective baselines, and independently trained specialists, PROMO achieves objective specialization and robustness from a single deployable policy. Across 100 sampled preferences in simulation, 67 behaviors are non-dominated under exact Pareto dominance, with a mean preference-objective correlation of 0.843, demonstrating broad Pareto coverage and predictable preference response. The same policy transfers zero-shot to a Unitree Go2, where preference changes alone reduce specific energy by up to 30.4%, position error by 38.7%, and peak body-attitude deviation by 59.0% relative to the balanced preference. These results establish preference-conditioned multi-objective RL as a practical runtime interface for adaptive legged locomotion, extending its role beyond offline Pareto-set construction. Open-source code and videos are available at https://amrmousa.com/promo/.