Search papers, labs, and topics across Lattice.
This paper introduces Optimo, a multi-level code optimization approach leveraging a Mixture-of-Prompts (MoP) architecture to enhance runtime efficiency in dynamic languages. By employing differential profiling, Optimo identifies performance bottlenecks and applies tailored optimization strategies across four levels of abstraction, significantly improving both human-written and LLM-generated code. The results show up to 57.48% optimization correctness and a remarkable 3.97x speedup for human-written code, outperforming existing methods by up to 96.51% in optimization effectiveness.
Achieving up to 3.97x speedup in human-written code, Optimo redefines how we optimize dynamic languages by employing a multi-level approach that outperforms traditional methods.
Runtime efficiency is a critical factor that impacts both software quality and user satisfaction. There are many approaches proposed for code optimization to improve runtime efficiency. Traditional code optimization methods operate on intermediate representations (IRs) during compilation for static languages. They are effective but struggle to handle dynamic languages that do not require compilation. Recently, large language models (LLMs) have been leveraged to directly optimize source code in dynamic languages. However, these methods fail to identify suitable optimization targets and usually conduct incomprehensive single-level optimization. To address these challenges, we propose Optimo, a multi-level LLM-based code optimization approach built on a novel Mixture-of-Prompts (MoP) architecture. In the MoP architecture, Optimo identifies time-critical code structures as performance bottlenecks via differential profiling. These structures are then routed to some optimization strategies, akin to expert models in MoE, each tailored to optimize specific code patterns. Unlike traditional approaches that focus only on statement-level optimizations, Optimo operates at four levels of abstraction, ranging from coarse-grained algorithmic improvements to fine-grained optimizations in API usage. We evaluate Optimo on two code efficiency benchmarks, COFFE and Effibench. Our results demonstrate that Optimo achieves an up to 57.48% opt%, i.e., the percentage of optimized programs that are correct and at least 10% faster than the original programs, and an up to 3.97x speedup when optimizing human-written code, and it consistently outperforms the best baseline by up to 96.51% in terms of opt%. Furthermore, Optimo achieves an up to 42.42% opt% and an up to 13.51x speedup when optimizing LLM-generated code.
