Search papers, labs, and topics across Lattice.
TopoFormer introduces a novel framework for graph representation learning that leverages topological structures through a new module called Topo-Scan, which converts graphs into ordered sequences of topological tokens. This method captures multi-scale structural patterns and processes them using a Transformer, achieving state-of-the-art performance in graph classification and molecular property prediction while maintaining efficiency and stability. The framework not only outperforms traditional methods but also integrates seamlessly with existing deep learning architectures, marking a significant advancement in the field.
TopoFormer achieves state-of-the-art performance in graph learning by seamlessly integrating topological structures into attention-based models, outperforming traditional methods.
We introduce Topoformer, a lightweight and scalable framework for graph representation learning that encodes topological structure into attention-friendly sequences. At the core of our method is Topo-Scan, a novel module that decomposes a graph into a short, ordered sequence of topological tokens by slicing over node or edge filtrations. These sequences capture multi-scale structural patterns, from local motifs to global organization, and are processed by a Transformer to produce expressive graph-level embeddings. Unlike traditional persistent homology pipelines, Topo-Scan is parallelizable, avoids costly diagram computations, and integrates seamlessly with standard deep learning architectures. We provide theoretical guarantees on the stability of our topological encodings and demonstrate state-of-the-art performance across graph classification and molecular property prediction benchmarks. Our results show that Topoformer matches or exceeds strong GNN and topology-based baselines while offering predictable and efficient compute. This work opens a new path for parallelizable and unifying approaches to graph representation learning that integrate topological inductive biases into attention frameworks.
