Search papers, labs, and topics across Lattice.
This study investigates the impact of agentic AI coding tools on software architecture by analyzing 151 open-source Java repositories, of which 74 exhibited detectable AI adoption. Using a staggered difference-in-differences design, the authors found that while the total architectural smell counts remained statistically unchanged, the architectural smell density declined by 6.7% due to a significant increase in lines of code. This suggests that the perceived architectural improvements are largely a result of increased code volume rather than genuine enhancements in architectural quality.
Agentic AI adoption in coding tools leads to a misleading decline in architectural smell density, driven by increased code volume rather than actual improvements.
AI coding tools are now used by a majority of developers, and agentic use of these tools has popularized the practice colloquially called"vibe coding". Yet causal evidence on their effect on software architecture is scarce. Prior causal work has measured code-level outcomes (complexity, static analysis warnings); whether such degradation propagates to architecture-level outcomes remains unknown. We mine 151 open-source Java repositories, 74 with detectable agentic AI adoption (identified via configuration files and Co-Authored-By commit trailers) and 77 propensity-matched controls, across a 13-month per-repository window yielding 1,811 monthly Arcan snapshots. We estimate the causal effect of adoption on architectural smell density (ASD) with a staggered difference-in-differences design and the Borusyak imputation estimator, applying a causal design recently used for code-level metrics to the architecture level. Total smell counts are essentially unchanged (+1.1%, p = 0.82) while lines of code grow +12.8% (p = 0.003); the resulting 6.7% ASD decline (p = 0.004) is therefore a denominator effect rather than an architectural improvement. Per-type estimates and robustness checks (wild cluster bootstrap, Lee bounds, stale-observation sensitivity) corroborate the pattern; pre-trends are flat (Wald p = 0.90), consistent with parallel trends. Density-normalized outcomes can mislead when treatment affects system size: raw counts and explicit decomposition are required for causal mining studies of AI tool adoption. The complete replication package, including the curated 151-repository monthly panel, is publicly available.
