Search papers, labs, and topics across Lattice.
Affiliation:
2
0
6
4
A large-scale empirical study of quality assurance (QA) practices in 157 open-source LLM-based agent projects with at least 100 GitHub stars highlights the need to move beyond feature-level testing toward systematic end-to-end validation that ensures agent workflows remain within intended boundaries when interacting with untrusted inputs, tools, persistent state, and external APIs.
It is concluded that autonomous APR agents cannot be trusted yet in production deployment, given their susceptibility to adversarial attacks.