Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses numerical instability in hyperbolic graph representation learning at large radii by introducing a novel one-parameter family of optimization preconditioners. By decoupling the embedding curvature from the optimization curvature, the authors demonstrate that a two-stage optimization strategy, combining a Euclidean preconditioner for initial layout and an intermediate curvature for refinement, significantly reduces loss on real-world tree data. This approach overcomes the limitations of existing models that fix the angular step scaling, leading to substantial performance gains.
A flexible hyperbolic optimization framework unlocks 46-74% loss reduction on hierarchical graphs by decoupling embedding and optimization curvatures.
Hierarchical graphs embed in hyperbolic space with lower distortion than in Euclidean space owing to its negative curvature. However, their gradient-based learning is hampered at large radii, where the Poincaré ball and the Lorentz hyperboloid models fail numerically. Polar coordinates avoid this problem, but the hyperbolic metric scales the angular step by the hyperbolic sine of the radius, freezing angular motion. We observe that this factor is a choice, silently fixed by existing implementations: the Euclidean tangent parametrization, for instance, uses the radius itself. We show that other choices are not only possible but preferable. They are endpoints of a one-parameter family of optimization preconditioners with curvatures from $-1$ to $0$, while the embedding remains at curvature $-1$. We show that since the Euclidean preconditioner rearranges a layout but refines it poorly, while an intermediate one refines far better once a layout is in place, combining them in two stages reduces the loss on real-world trees by 46-74% over the best single curvature.