Search papers, labs, and topics across Lattice.
This longitudinal study utilized the Adaptive Developer Efficiency Monitoring Method (ADEMM) to analyze factors affecting developer efficiency among 27 external software developers over twelve data collection waves. It identified persistent bottlenecks such as organizational dependencies and validation delays, while also revealing a significant decline in technical knowledge gaps as developers adapted. Notably, a new barrier related to generative AI usage emerged midway through the study, highlighting the dynamic nature of perceived developer efficiency and the need for adaptive monitoring approaches.
Developer efficiency is more dynamic than previously thought, with generative AI usage barriers emerging as a critical challenge only after several months of monitoring.
Context: Developer efficiency is driven by technical, organizational, and personal factors, yet few longitudinal studies explore how these factors evolve over time. Objective: This study investigates the primary factors hindering the perceived efficiency of developers in a consulting and professional development context, analyzing how these factors vary across recurring data collection cycles and how they are described qualitatively. Method: We conducted a mixed-methods longitudinal case study applying the Adaptive Developer Efficiency Monitoring Method (ADEMM) to 27 external software developers, combining twelve waves of periodic surveys with eighteen semi-structured interviews, analyzed through statistical and thematic analysis. Results: The most frequent bottlenecks were organizational dependencies and waiting for external validation, which stayed structurally stable, followed by technical knowledge gaps, which declined as developers adapted. A generative AI usage barrier emerged qualitatively nine waves into the study, was incorporated into the survey instrument, and became the most frequently coded interview theme. Interviews corroborated the quantitative findings, with insufficient requirements documentation and organizational dependencies as the most recurrent themes alongside AI-related challenges. Conclusions: Perceived developer efficiency is highly dynamic and cannot be accurately captured through a single cross-sectional measurement. Adaptive monitoring via ADEMM identified an emerging factor, generative AI usage barriers, that a fixed instrument would have missed, and informed a concrete organizational intervention during the study. For organizations managing external developers, actions should target external dependencies, communication channels, and developers'evolving use of AI tools.
