Search papers, labs, and topics across Lattice.
This paper introduces ESR-HGNN, a novel redundancy-aware sampling paradigm designed to optimize mini-batch inference in heterogeneous graph neural networks (HGNNs) by eliminating semantic redundancy during graph traversal. The method employs a metapath trie to minimize redundant memory accesses and introduces a reusability-driven metapath grouping technique to enhance traversal efficiency, particularly in scenarios characterized by semantic parallelism. Experimental results show that ESR-HGNN achieves a tenfold improvement in sampling performance over traditional CPU and GPU methods, alongside significant energy savings and faster end-to-end inference when integrated with existing accelerators.
Eliminating semantic redundancy in HGNNs can boost sampling performance by an order of magnitude, transforming mini-batch inference efficiency.
Heterogeneous graph neural networks (HGNNs) are highly effective in processing heterogeneous graph data and have been widely adopted in critical domains. As real-world graph data continues to scale, performing direct inference on entire graphs becomes increasingly infeasible, making mini-batch methods the standard approach. However, in end-to-end HGNN inference, metapath-based mini-batch sampling constitutes a significant performance bottleneck due to the extensive random memory accesses induced by the irregular traversal of graph structures. Existing sampling paradigms suffer from excessive redundant traversals caused by inherent semantic redundancy, severely degrading sampling efficiency and, consequently, leading to suboptimal mini-batch inference performance. In this work, we propose a redundancy-aware HGNN sampling paradigm that leverages a metapath trie to reuse traversal paths, effectively eliminating redundant memory accesses. We then map it onto a multi-channel hardware sampling unit denominated ESR-HGNN. Furthermore, we introduce a reusability-driven metapath grouping technique that optimally clusters metapaths to maximize reusable traversal paths within hardware channels, enhancing efficiency in scenarios with semantic parallelism. Extensive experimental results demonstrate that ESR-HGNN achieves an average sampling performance improvement of one order of magnitude over CPU and GPU, accompanied by significant energy savings. Additionally, it delivers substantial speedup in end-to-end mini-batch inference when integrated with GPU and state-of-the-art HGNN inference accelerator.
