Search papers, labs, and topics across Lattice.
This study conducts a cross-layer analysis of wafer-scale optical interconnects specifically for mixture-of-experts (MoE) workloads, highlighting the challenges posed by thermal fluctuations on conventional thermo-optic tuning mechanisms. By employing workload profiling, packet-level network simulation, and transient thermal analysis, the authors demonstrate that transient temperature variations can lead to significant tuning stalls during communication phases. The introduction of a ferroelectric-based electro-optic tuning mechanism effectively eliminates these stalls, resulting in performance speedups of up to 3.8x across various MoE models compared to traditional methods.
Eliminating thermal-induced tuning stalls in optical interconnects can boost MoE model performance by up to 3.8x, unlocking new potential for large-scale AI systems.
The rapid scaling of large language models (LLMs), particularly mixture-of-experts (MoE) architectures, has intensified interconnect demands because expert-parallel execution is communication-intensive. Wafer-scale optical interconnects based on dense wavelength-division multiplexing (DWDM) offer a promising path to higher bandwidth; however, conventional microring-resonator (MRR)-based links rely on thermo-optic tuning and are therefore vulnerable to workload-induced thermal fluctuations. In this work, we present a cross-layer analysis of wafer-scale optical interconnects for MoE workloads that combines workload profiling, packet-level network simulation, and transient thermal analysis. We implement a wafer-scale topology in the ht-sim simulator and construct an Ansys thermal model of a 3D-integrated GPU/EIC/PIC stack. Our results show that transient temperature variations can exceed the tracking capability of conventional thermo-optic control loops and thereby introduce repeated tuning stalls during communication phases. The stall durations injected into the network simulation are derived directly from the thermal model rather than assumed. We further evaluate a ferroelectric-based electro-optic tuning mechanism that removes the continuous thermal-tuning requirement. In a four-layer proxy simulation across three MoE models, eliminating the tuning stalls yields speedups of 2.7x for Mixtral 8x7B, 3.8x for Qwen-MoE 14.3B, and 3.3x for LLaMA-MoE 6.7B relative to the thermo-optic case. These results indicate that minimizing photonic tuning latency is important for realizing the performance potential of optical interconnects in large-scale AI systems.
