Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper identifies inefficiencies in the full-code generation paradigm for LLM-based code editing due to unnatural diff formats. They introduce BlockDiff and FuncDiff, structure-aware diff formats that represent edits as block-level rewrites of syntactic units. AdaEdit, an adaptive strategy, is proposed to dynamically select the most token-efficient format (diff or full code), achieving comparable accuracy to full-code generation while reducing latency and cost by over 30% on long-code editing tasks.
LLMs can edit code 30% faster and cheaper without sacrificing accuracy, simply by learning to choose between generating full code and structure-aware diffs.
Large Language Models (LLMs) are increasingly used for code editing, yet the prevalent full-code generation paradigm suffers from severe efficiency bottlenecks, posing challenges for interactive coding assistants that demand low latency and cost. Despite the predominant focus on scaling model capabilities, the edit format itself has been largely overlooked in model training. In this paper, we begin with a systematic study of conventional diff formats and reveal that fragile offsets and fragmented hunks make generation highly unnatural for LLMs. To address it, we introduce BlockDiff and FuncDiff, two structure-aware diff formats that represent changes as block-level rewrites of syntactically coherent units such as control structures and functions. Furthermore, we propose AdaEdit, a general adaptive edit strategy that trains LLMs to dynamically choose the most token-efficient format between a given diff format and full code. Extensive experiments demonstrate that AdaEdit paired with structure-aware diff formats consistently matches the accuracy of full-code generation, while reducing both latency and cost by over 30% on long-code editing tasks.