Search papers, labs, and topics across Lattice.
The paper introduces guiding principles for a reference framework and an initial tool, SEAL, for estimating the carbon footprint of LLM inference at the prompt level. SEAL uses a multi-benchmark-driven approach to estimate per-prompt carbon emissions, addressing the increasing concern that inference emissions surpass training emissions due to high prompt volumes. Initial validation of SEAL demonstrates its potential as a foundation for standardized sustainability assessment in the LLM ecosystem.
Accurately measuring the carbon footprint of each LLM prompt is now possible with SEAL, a new tool that could drive more sustainable LLM usage.
Large Language Models are rapidly gaining traction in software engineering, yet their growing carbon footprint raises pressing sustainability concerns. While training emissions are substantial, inference quickly surpasses them due to the sheer volume of prompts processed. This shift underscores the urgent need for accurate, prompt-level carbon measurement during inference to enable informed, sustainability-focused decision-making. To address the limitations of existing approaches, in this paper, we outline the guiding principles for a novel reference framework for LLM inference carbon estimation that can guide the design of future tools and provide a systematic foundation for advancing sustainability research in this domain. We also introduce SEAL, an early embodiment of these principles that leverages a multi-benchmark-driven approach for per-prompt carbon estimation. Its initial validation shows promising results, positioning SEAL as a foundation for standardized sustainability assessment across the LLM ecosystem.
