Search papers, labs, and topics across Lattice.
This thesis presents a comprehensive framework for Riemannian deep learning that integrates reusable neural modules, manifold-specific architectures, and innovative geometric designs. It generalizes batch normalization and multinomial logistic regression to accommodate a wide range of Lie groups and gyrogroups, while also developing advanced neural networks for various geometric representations, including hyperbolic spaces and correlation matrices. Key innovations include adaptive Riemannian metrics on SPD manifolds, demonstrating both theoretical robustness and practical effectiveness across diverse applications in vision, signal processing, graph learning, and genomics.
Generalizing batch normalization to Lie groups could revolutionize how we train neural networks on manifold-valued data.
Deep neural networks on manifold-valued representations have attracted growing interest, but many basic components remain tied to specific manifolds, rely on Euclidean approximations, or require costly and numerically fragile geometric operations. This thesis develops a unified framework for Riemannian deep learning from three complementary perspectives: reusable neural modules, manifold-specific network architectures, and the design of underlying geometries. It generalizes batch normalization from Euclidean spaces and individual manifolds to broad classes of Lie groups and gyrogroups, and extends multinomial logistic regression from Euclidean space to SPD manifolds and then to general Riemannian manifolds. It further develops neural networks for several important geometric representations, including an unconstrained model of hyperbolic space, Busemann-based hyperbolic learning, and full-rank correlation matrices. Finally, it introduces adaptive and computationally efficient Riemannian metrics on SPD manifolds, including learnable Log-Euclidean geometries and fast, stable Cholesky-based geometries. The proposed methods are supported by theoretical analysis and validated through numerical experiments and applications in vision, signal processing, graph learning, and genomics.
