Search papers, labs, and topics across Lattice.
This study introduces the Adaptive Developer Efficiency Monitoring Method (ADEMM), a longitudinal approach designed to continuously assess developer efficiency in contexts where organizations do not directly employ the developers. By conducting a mixed-method longitudinal study with 27 software developers over twelve survey cycles, the researchers refined ADEMM through iterative cycles of design, data collection, and evaluation. The key result is a method that integrates recurring surveys and qualitative insights, yielding three design principles that enhance the adaptability and actionability of monitoring instruments in dynamic environments.
Continuous monitoring of developer efficiency is now possible even in non-employment contexts, revealing how barriers evolve over time.
Context: Developer efficiency is influenced by technical, organizational, cognitive, and communication-related factors. However, most studies rely on one-time assessments or fixed instruments, limiting the ability to monitor how barriers emerge and change over time, especially in consulting and professional education contexts. Objective: This study proposes and evaluates the Adaptive Developer Efficiency Monitoring Method (ADEMM), an adaptive longitudinal method for monitoring developer efficiency when the monitoring organization does not directly employ the developers. Method: Following Design Science Research and Action Design Research, we conducted a mixed-method longitudinal study with 27 software developers over twelve survey cycles. ADEMM was designed and refined through five iterative cycles, combining recurring surveys, 18 semi-structured interviews, and joint evaluation with a problem owner. Results: The study resulted in ADEMM, a method that supports continuous data collection, mixed-methods integration, and iterative redesign of monitoring instruments. The evaluation produced three design principles: prioritization with the problem owner based on actionability, combination of closed and open data collection, and adaptation of items based on low variance and emerging qualitative signals. Conclusions: ADEMM provides a transferable approach for adaptive longitudinal monitoring of developer efficiency. It helps balance comparability, contextual sensitivity, and practical utility in environments where organizations need to support developers without directly controlling their work contexts.
