Search papers, labs, and topics across Lattice.
This study investigates the adoption and utilization of GitHub Actions (GHA) by analyzing 258,300 workflow run records from 952 repositories, complemented by a qualitative analysis of 21 diverse repositories. The findings reveal three distinct patterns of developer responses to workflow failures, a correlation between higher GHA usage intensity and lower failure rates, and a notable configuration-usage gap where configuration files often conceal inactive workflows. These insights not only highlight the complexities of real-world GHA usage but also propose five hypotheses regarding the interplay between project characteristics and workflow utilization for future exploration.
Developers often overlook inactive workflows, leading to a significant configuration-usage gap in GitHub Actions that could skew project reliability assessments.
Continuous Integration and Continuous Deployment (CI/CD) have become fundamental to modern software development, with GitHub Actions (GHA) emerging as a dominant automation platform. In this study, we analyze real-world execution records of GHA, examining how developers react to workflow failures, how these workflows are utilized by projects, and how these aspects relate to project characteristics. We quantitatively analyze 258,300 workflow run records from 952 repositories and perform an in-depth qualitative analysis of 21 selected, diverse GitHub repositories to understand how maintainers and contributors interact with workflow results. We identify three distinct failure response patterns, observe that higher usage intensity of GHA workflows correlates with lower failure rates, and uncover a configuration-usage gap where the presence of configuration files masks disabled or unused workflows. Moreover, our qualitative analysis of relationships between project characteristics and utilization patterns yields five hypotheses for future validation.