Search papers, labs, and topics across Lattice.
This paper introduces Taurus, a novel single-machine system designed for efficient GNN inference on billion-scale graphs that exceed RAM capacity. By reformulating layer-wise inference into source-centric broadcasts and leveraging a pipelined GPU-CPU-SSD architecture, Taurus significantly reduces memory overhead and disk I/O costs. The system achieves remarkable performance improvements, outperforming existing baselines by factors ranging from 7 to 140 times on large out-of-core graphs.
Taurus accelerates GNN inference on billion-scale graphs by up to 140 times, revolutionizing how we handle massive datasets in real-time applications.
Graph Neural Network (GNN) inference on billion-scale graphs is challenging due to the large memory footprint of features and embeddings and high disk I/O costs in out-of-core settings. Existing distributed GNN systems incur high communication times and infrastructure costs, while disk-based GNN systems are primarily tailored to training and experience massive wasted reads during inference on the entire graph. We present Taurus, a single-machine system for GNN inference on graphs that do not fit in RAM, supporting both \textit{exact} full-graph inference and fanout-sampled inference. To avoid random and repeated feature gathers, Taurus reformulates layer-wise inference as source-centric broadcasts over sequential SSD scans, backed by a pipelined GPU-CPU-SSD hierarchy, topology-aware reordering, pending-message eviction, and a GPU-resident store for high-degree vertices. It further uses non-buffered sequential reads and GPU-backed writes to reduce page-cache pollution, host-memory pressure, and write overheads. On out-of-core graphs with up to $269M$ vertices, $4B$ edges, and $514$ GiB of features, Taurus outperforms the strongest layer-wise baseline, DGI, by $7$-$25\times$, and vertex-wise baselines by $40$-$140\times$.
