Search papers, labs, and topics across Lattice.
This study investigates how cognitive diversity among developers influences their interactions with GitHub Copilot chat, identifying five distinct "interaction modes" and ten underlying needs. By employing a mixed-methods think-aloud approach with 27 participants, the research reveals significant links between developers' problem-solving styles, experience levels, and their specific needs when using programming assistants. The findings underscore the necessity for tailored design in AI tools to accommodate the varied preferences and requirements of developers, enhancing their overall effectiveness.
Cognitive diversity among developers leads to distinct interaction modes with programming assistants, revealing that one-size-fits-all solutions may fall short.
Conversational LLM-based ``programming assistants'' provide a range of benefits to developers. However, recent studies demonstrate the variety in individual developers' needs regarding programming assistants, and challenges encountered by only specific groups of developers. In this study, we explore the role of cognitive diversity in shaping interactions with GitHub Copilot chat. Through a mixed-methods think aloud study with 27 professional developers and students, we characterize 5 distinct ``interaction modes'' and 10 underlying needs in developers' interactions, forming a conceptual model. We characterize links between these modes, needs, and developers' problem-solving styles and experience profiles, showing how cognitive diversity may shape developers' interactions. We provide insights and recommendations for researchers and practitioners on how to design, research, and employ programming assistants to better account for diverse developer needs.
Microsoft Research