Search papers, labs, and topics across Lattice.
This paper proposes a preliminary reliance-control framework to help software developers determine an appropriate level of reliance on AI-powered tools like LLMs. Through 22 interviews with software developers, the study identifies different levels of control that can indicate overreliance (leading to skill atrophy) or underreliance (missing productivity gains). The framework aims to guide future research and promote responsible AI use by providing a structured approach to assessing and adjusting reliance on AI in software engineering.
Software developers are struggling to find the "Goldilocks zone" of AI reliance, and this framework offers a way to diagnose and address both over- and under-reliance on LLMs.
How software developers interact with Artificial Intelligence (AI)-powered tools, including Large Language Models (LLMs), plays a vital role in how these AI-powered tools impact them. While overreliance on AI may lead to long-term negative consequences (e.g., atrophy of critical thinking skills); underreliance might deprive software developers of potential gains in productivity and quality. Based on twenty-two interviews with software developers on using LLMs for software development, we propose a preliminary reliance-control framework where the level of control can be used as a way to identify AI overreliance and underreliance. We also use it to recommend future research to further explore the different control levels supported by the current and emergent LLM-driven tools. Our paper contributes to the emerging discourse on AI overreliance and provides an understanding of the appropriate degree of reliance as essential to developers making the most of these powerful technologies. Our findings can help practitioners, educators, and policymakers promote responsible and effective use of AI tools.
