Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Hyperbolic Goal-Conditioned Reinforcement Learning (Hyperbolic CRL) by replacing Euclidean distances with geodesic distances in hyperbolic space within the contrastive objective. This geometric adaptation addresses the mismatch between Euclidean distance and actual route distance in complex navigation environments, leading to significantly improved performance with shallower networks. Hyperbolic agents achieve state-of-the-art goal-reaching performance, outperforming 1024-layer Euclidean networks with 64-layer hyperbolic networks that train over 12x faster and use 13x fewer parameters.
Hyperbolic geometry enables RL agents to navigate complex mazes with 13x fewer parameters and 12x faster training than massive Euclidean networks, by aligning representation geometry with task demands.
Scaling self-supervised contrastive reinforcement learning (CRL) to 1000-layer Euclidean neural networks has enabled state-of-the-art goal-reaching performance, yet wall-clock time scales linearly with depth. We find that changing the geometry achieves stronger performance with far shallower networks. This matters in complex navigation environments, where walls can make route distance deviate substantially from Euclidean distance. In a U-shaped maze, we show that the longer the route, the more it deviates from Euclidean distance. Hyperbolic CRL addresses this mismatch by replacing Euclidean distances in CRL's contrastive objective with geodesic distances in hyperbolic space. On hard navigation tasks, inductive bias beats scale: depth 64 hyperbolic agents outperform 1024-layer-deep Euclidean networks while training more than $12 \times$ faster and using about $13 \times$ fewer parameters. We observe that hyperbolic agents behave qualitatively better in hard humanoid mazes, where they follow corridors to reach goals, whereas Euclidean agents try straight-line shortcuts over walls. Our results show that matching the representation geometry to the task can substitute for substantial network depth. Code is at https://github.com/Probabilistic-and-Interactive-ML/HypGCRL .