Search papers, labs, and topics across Lattice.
This paper introduces Game-Guided Skill Discovery (GGSD), a self-play framework that trains hierarchical agents to discover semantically distinct and interpretable motor skills for embodied agents. By leveraging competitive gameplay, GGSD grounds skill discovery in a discrete skill set, enabling a human to directly control the agent through these learned primitives. The key result is that these discovered skills can be composed by humans to solve novel tasks without further training, demonstrating emergent expressivity beyond individual skill behaviors.
Humans can directly control complex embodied agents using a handful of learned, composable skills discovered through self-play, bypassing the need for low-level action control.
We present Game-Guided Skill Discovery (GGSD), a framework that uses self-play in games to discover motor skills that are directly playable by humans. Playable skills provide a compact abstraction for controlling embodied agents through a small set of learned behaviors rather than low-level actions. To be effective, these skills should be semantically distinct, interpretable, and expressive; properties that existing unsupervised skill-discovery methods often fail to achieve simultaneously. GGSD achieves these desiderata by grounding skill discovery in competitive gameplay. A hierarchical agent competes against its past selves, with a high-level policy selecting from a small discrete skill set and a skill-conditioned low-level policy learning the corresponding behaviors. After training, a human can replace the high-level policy and directly control the agent through the same discrete skills. Despite the small number of high-level actions, skill transitions give rise to emergent combo behaviors, expanding expressivity beyond individual primitives. Across Ant, Franka-arm, and Unitree G1 environments, we show that GGSD produces human-playable skills that humans can compose to solve unseen tasks, such as Maze and CubePush, without additional training. An interactive demo is available at https://ggsd-demo.github.io.