Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the computational bottleneck of full-domain training in Topological Deep Learning by introducing Cluster-TNN, a framework that lifts graph data locally within dynamically sampled clusters. By partitioning the input graph and reconstructing induced subgraphs for mini-batches, Cluster-TNN avoids global materialization of higher-order structures. This approach significantly reduces GPU memory usage (83.2% on average) while enabling the training of higher-order Topological Neural Networks on large-scale datasets like Reddit and OGBN Products, a feat previously infeasible.
Training higher-order Topological Neural Networks on massive graphs like Reddit is now possible, thanks to a novel clustering-based mini-batching strategy that slashes GPU memory requirements by over 80%.
Topological Deep Learning extends graph-based learning to higher-order domains, such as hypergraphs, cellular, and simplicial complexes. These domains are typically constructed from patterns in an input graph through a process of graph lifting. Full-domain training constructs and stores the complete lifted representation before model execution. On large and dense datasets like Reddit (233k nodes and 57.3M edges), this global materialization becomes a severe computational bottleneck, often rendering training infeasible. To address this limitation, we introduce Cluster-TNN, a domain-agnostic framework that avoids this bottleneck by lifting locally instead. After partitioning the input graph during preprocessing, at runtime Cluster-TNN dynamically samples groups of node clusters, reconstructs their induced subgraphs to form mini-batches, and applies the chosen lifting within each mini-batch. Retaining all edges among sampled nodes preserves the connectivity needed to construct higher-order structures across clusters, producing topological mini-batches that existing Topological Neural Networks can process directly. Across 21 matched comparisons with full-graph execution, Cluster-TNN reduces peak GPU memory in every configuration, by 83.2% on average while maintaining competitive predictive performance. Notably, such a reduction enables, to our knowledge, the first training of multiple different higher-order Topological Neural Networks on large datasets such as Reddit and OGBN Products. These results establish Cluster-TNN as a general strategy for scaling Topological Deep Learning beyond the limitations of global domain construction.