Search papers, labs, and topics across Lattice.
This paper introduces energy calculus, a novel compositional algebra that treats energy as a first-class primitive in computational systems, addressing the limitations of traditional energy optimization methods that lack generalizability. By defining energy elements with measurable energy signatures and employing three operators for composition, the authors provide a framework that allows for the integration of various energy-saving techniques across different granularities and structures. The approach not only captures the complexities of energy consumption in hardware but also enables the propagation of uncertainty through compositions, ensuring that predictions are accompanied by error bounds.
Energy calculus reveals that energy optimization can be systematically composed, transforming how we approach energy efficiency in AI systems.
Energy is a binding constraint for AI scaling, yet it lacks the formal treatment that computation, communication, and learning have long enjoyed. Recent systems demonstrate large energy savings, but each targets a specific granularity and structure; one cannot combine frequency scaling from one system with critical-path analysis from another and reason about their joint effect on total energy. Energy remains a monolithic scalar that is measured after the fact and optimized with point solutions that do not generalize. We propose energy calculus, a compositional algebra that treats energy as a first-class primitive. It builds on energy elements, units of computation whose energy we can reliably measure, each carrying an energy signature that comprises its time, its static and dynamic energy, the hardware operating point and execution context under which we measured it, and the associated measurement uncertainty. Three operators (sequential, same-device parallel, and cross-device parallel) compose signatures along the same structure as the computation itself, covering arbitrary DAG-structured executions. The algebra rests on seven axioms that capture how hardware consumes energy, and it exhibits two properties distinctive to energy among computing resources: sequential composition commutes only when elements are mutually context-insensitive, and sequential composition does not distribute over parallel composition. We also present a Reduction Theorem that recovers simple context-independent algebra whenever interactions fall below measurement uncertainty, so practitioners pay for context dependence only where the physics demands it. Uncertainty propagates through every composition, so each prediction carries an error bound. Finally, we show that the same operators extend from energy totals to time--energy Pareto frontiers, so reasoning about tradeoffs composes with the same algebra.
