Search papers, labs, and topics across Lattice.
This paper introduces SOLAR, a framework that automates the derivation of validated Speed-of-Light (SOL) bounds from PyTorch and JAX code, addressing the manual and error-prone nature of traditional SOL analysis. By integrating a generative LLM frontend with a deterministic flow and analytical backend, SOLAR computes theoretical execution limits while ensuring zero observed SOL violations. Evaluations across various workloads reveal SOLAR's capabilities in headroom analysis, optimization identification, cross-platform exploration, and hardware provisioning, significantly enhancing the efficiency of performance analysis in deep learning models.
SOLAR achieves zero observed violations in Speed-of-Light performance analysis, transforming how we approach deep learning optimizations.
How fast could a deep-learning model run on target hardware, and how far is today's implementation from that limit? These questions are central to software, hardware, and algorithm optimizations. Speed-of-Light (SOL) analysis answers them by computing a workload's theoretical minimum execution time on a given architecture. Yet deriving SOL bounds remains manual, error-prone, and disconnected from rapid model development. To close this gap, we introduce SOLAR, a framework that automatically derives validated SOL bounds from PyTorch and JAX source code. SOLAR leverages both generative and deterministic components in its flow: an LLM frontend translates any source programs into an executable Affine Loop IR, validated by output comparison; a deterministic flow lifts the IR into an einsum graph; and an analytical backend computes unfused, fused, and cache-aware SOL bounds. SOLAR provides comprehensive operator and language coverage, produces validated bounds with zero observed SOL violations, and offers multi-fidelity analysis that tightens bounds and surfaces optimization insights. We evaluate SOLAR across KernelBench, JAX/Flax models, and robotics workloads. These experiments demonstrate four use cases: headroom analysis at multiple fidelity levels, identifying optimization opportunities, cross-platform exploration, and inverse-roofline hardware provisioning.
