Search papers, labs, and topics across Lattice.
GeoGAE resolves the long-standing scalability bottleneck in graph-level autoencoding—where models struggle with permutation invariance or combinatorial node-matching—by mapping graphs into hyperball cloud representations that induce a canonical node ordering. This geometric formulation allows vanilla Transformer encoder-decoders to compress entire topologies into fixed-size Euclidean embeddings and invertibly reconstruct both global and local relational patterns. Empirical evaluations across diverse domain benchmarks show the model achieves robust graph reconstruction fidelity without the quadratic computational overhead of traditional node-alignment methods.
Graph-level autoencoding no longer requires intractable node-matching or permutation-invariance hacks: casting graphs as hyperball clouds provides a canonical ordering that makes standard Transformers efficient, invertible graph compressors.
Embedding structured objects into Euclidean spaces has enabled a wide range of successful machine learning applications. Such objects include words, documents, image patches, time series, and graph nodes. In contrast, embedding entire graphs remains a challenging problem. Existing methods either sustain the original order of the graph nodes or match the output nodes to the input ones, both of which create scalability issues. In this work, we propose a graph representation as a cloud of hyperballs, which allows us to define a specific, typically unique, node ordering. Based on this representation, we propose GeoGAE, an autoencoder, in which the Transformer encoder translates a hyperball cloud into a graph-level embedding, and the Transformer decoder translates the graph-level embedding back into the graph. This formulation enables the model to capture both the global graph structure and local relational patterns. We evaluate our method on multiple graph datasets, spanning various domains. The results demonstrate effectiveness of our method in encoding and reconstructing graphs from their embeddings.