Search papers, labs, and topics across Lattice.
This paper introduces ML-for-ML, a novel approach that jointly optimizes network and machine learning parameters to enhance training efficiency in shared cloud environments. By addressing the separation between networking controls and ML training choices, the authors demonstrate that co-optimizing these components can significantly improve end-to-end performance. Their preliminary prototype achieves a target loss up to 42% faster compared to traditional methods, highlighting the potential for more efficient AI training workloads.
Co-optimizing network and ML parameters can accelerate training by up to 42%, unlocking new efficiencies in AI workloads.
AI training workloads are growing rapidly, making their time, energy, and infrastructure costs increasingly important. In shared cloud clusters, training and fine-tuning jobs compete with co-running workloads for network resources, while network mechanisms and ML training choices are typically optimized separately: networking controls how bytes move, whereas ML systems control when and how much communication occurs. We argue that this separation leaves end-to-end performance on the table. We present ML-for-ML, a cross-layer perspective in which network-side and ML-side knobs are selected jointly under a shared time-to-target-loss objective. Our preliminary prototype shows that by co-optimizing the ML and network parameters, we reach the target loss up to 42% faster.
