Search papers, labs, and topics across Lattice.
SOLANET is introduced as a GPU-accelerated distributed toolkit for constructing neighbor graphs, addressing the challenges of scaling approximate nearest neighbor search to distributed systems. It constructs local graphs on each GPU and refines them using ANN searches over remote graphs fetched via MPI one-sided communication. Experiments show that SOLANET outperforms state-of-the-art single-GPU implementations and achieves up to 11x speedup scaling from 32 to 512 AMD MI300A APUs.
Scaling neighbor graph construction to billions of data points is now 11x faster thanks to SOLANET's distributed GPU acceleration.
Neighbor graphs capture relationships among data points and are widely used in data analytics and AI workloads. Many studies have explored approximate construction methods for single-node systems, including GPUs. However, extending this to distributed systems for larger data and further acceleration remains challenging due to irregular computation patterns. We present SOLANET, a GPU-accelerated distributed neighbor graph construction toolkit. SOLANET first constructs local graphs on each GPU after data partitioning and then refines them via approximate nearest neighbor (ANN) searches over remote graphs pulled from other GPUs using MPI one-sided operations. SOLANET also provides a lock-free single-GPU neighbor graph construction algorithm for AMD GPUs. Our single-GPU implementation outperforms a state-of-the-art GPU-based approximate neighbor graph construction implementation across multiple datasets on a single MI300A APU. Furthermore, SOLANET demonstrates 11X speedup from 32 to 512 APUs for 1 billion data points and 6.9x speedup from 64 to 512 APUs for 2 billion points.