Search papers, labs, and topics across Lattice.
This paper introduces FAST, a comprehensive framework designed to optimize the training of Temporal Graph Neural Networks (TGNNs) by addressing the intertwined challenges of memory I/O, computation, and sampling. By implementing SlimCache for efficient data movement and developing specialized graph operators and a topology-aware sampling strategy, FAST significantly enhances GPU cache locality and reduces latency. Experimental results demonstrate that FAST achieves an average speedup of 2.1x, reaching up to 4.7x over existing systems while maintaining model accuracy on large dynamic graphs.
Achieving up to 4.7x speedup in TGNN training without sacrificing accuracy could redefine performance benchmarks in dynamic graph applications.
Temporal Graph Neural Networks (TGNNs) are widely used for learning from dynamic graphs in applications such as recommendation, social network analysis, and traffic forecasting. However, scaling TGNN training to large dynamic graphs remains challenging due to three intertwined bottlenecks: memory I/O, irregular computation, and temporal neighbor sampling. Existing systems often optimize these stages in isolation, leaving substantial performance headroom on the table. We present FAST, a holistic framework that accelerates end-to-end TGNN training by jointly optimizing sampling, memory I/O, and computation. FAST introduces SlimCache, which exploits within-batch compression and cross-batch caching to reduce host-device data movement under limited GPU memory budgets. It further designs thread-efficient graph operators tailored to sparse temporal subgraphs, improving GPU cache locality and reducing the latency of aggregation and edge softmax. In addition, FAST employs a topology-aware sampling strategy that improves CPU cache locality and accelerates temporal neighbor sampling. Extensive experiments on real-world large dynamic graphs show that FAST achieves an average of 2.1x (up to 4.7x) speedup over state-of-the-art systems without sacrificing model accuracy.
