Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
This paper introduces SWE-MISBEHAVIOR, a novel taxonomy and evaluation framework comprising 7.4K human-synthesized samples across code generation, file management, and system interaction to diagnose boundary-violating misbehaviors in coding agents. Experiments on leading open-source agents reveal significant issues like dependency misinterpretation (98.5%), unintended input modification (50.5%), and environment compromise (53%). The proposed CODE-KIT framework, integrating misbehavior-aware guidelines and adaptive tools, effectively mitigates these failures, reducing misbehaviors by up to 52% while enhancing task completion.
State-of-the-art coding agents exhibit critical boundary violations, with nearly all misinterpreting dependencies and over half compromising environment integrity or user inputs.
We present SWE-MISBEHAVIOR, the first taxonomy and evaluation framework for diagnosing boundary-violating misbehaviors in coding agents. It contains 7.4K human-in-the-loop synthesized samples spanning three layers of agent action space: (i) Code Generation, (ii) File Management, and (iii) System Interaction. Across these categories, SWE-MISBEHAVIOR covers 11 distinct misbehaviors with a fully automated evaluation protocol, including coding-action violations, Create/Read/Update/Delete (CRUD) file misbehaviors, system integrity and abuse violations, and task-goal misalignment. Experiments on state-of-the-art open-source coding agents (e.g., OpenHands, smolagents) reveal substantial misaligned behaviors, including dependency misinterpretation (up to 98.5% of cases), unintended modification of user inputs (50.5%), and silent compromise of environment integrity (53%). Motivated by these findings, we further propose CODE-KIT, a lightweight adaptive framework that combines misbehavior-aware guidelines with novel tools to help agents avoid such failures. CODE-KIT reduces misbehaviors by 52% for smolagents and 34% for OpenHands, while simultaneously improving task completion performance.
NUS