Search papers, labs, and topics across Lattice.
This paper introduces C2C-Explorer, an adaptive Bayesian design space exploration (DSE) framework tailored for chip-to-chip (C2C) interconnect architectures in large language model (LLM) cloud computing systems. The framework addresses critical challenges in simulating realistic LLM-specific C2C traffic and efficiently navigating the vast design space, achieving significant performance improvements in goodput and memory usage. Validation against FPGA prototypes shows the simulator's end-to-end timing error ranges from 2.46% to 8.23%, while enabling up to 7.8 times faster simulation compared to traditional methods.
C2C-Explorer boosts LLM inference efficiency, achieving a 44.1% increase in goodput and a staggering 98.4% reduction in memory usage.
The scaling-up of large language models (LLMs) necessitates computing systems to have multi-processor-chip architectures, elevating the importance of chip-to-chip (C2C) communication. However, designing efficient C2C hardware architectures for LLM workloads faces three key challenges: generating realistic LLM-specific C2C traffic, accurately simulating hardware-level communication at scale, and efficiently exploring the exponentially large C2C design space. We propose C2C-Explorer, an adaptive Bayesian DSE framework that integrates a LLM-workload-driven traffic generator, a scalable interconnect simulator (switch/full-mesh, up to 512 chips), and a metric-guided evaluator into a workload-to-hardware optimization pipeline, enabling systematic C2C architectural co-design under realistic LLM workloads. Validated against FPGA-based C2C prototypes, the C2C simulator achieves 2.46-8.23% end-to-end timing error across diverse traffic patterns. Its hybrid cycle and event model further accelerates large-scale simulation by up to 7.8$\times$ over a pure cycle-accurate baseline. Applied to a 32-XPU DeepSeek-R1-671B inference workload, C2C-Explorer identifies configurations that improve goodput by 44.1% and reduce memory by 98.4%. C2C-Explorer is open-source and available at https://github.com/Selinaee/C2C-Explorer.
DAMO