Search papers, labs, and topics across Lattice.
Flint is a novel framework that utilizes the Intermediate Representation of ML compilers to facilitate flexible design space exploration for distributed Machine Learning systems. By interfacing with the compiler prior to hardware execution, Flint can generate workload representations for arbitrary cluster sizes, thereby overcoming limitations in existing approaches. Validation against post-execution traces confirms its effectiveness, showcasing Flint's potential through a design space exploration case study.
Flint enables unprecedented flexibility in exploring distributed ML design spaces by leveraging compiler insights, allowing for workload representation across any cluster size.
Design space exploration for future distributed Machine Learning systems suffers from a lack of readily available workload representation that enables flexible exploration across the stack. We present Flint, a framework that bridges this gap by leveraging the Intermediate Representation of Machine Learning framework compilers. The compiler does the heavy weight lifting of understanding and preserving the behavior of the original model code. Flint can collect the workload representation of arbitrary cluster size because it interfaces with the compiler before hardware execution. We validate the workload graph against post-execution traces and show the flexibility of Flint through a design space exploration case study.
NVIDIA