Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces ATTest, an agent-driven framework for generating module-level unit tests for DL libraries that addresses the limitations of SBST and LLMs in handling complex tensor constraints and cross-file contexts. ATTest employs a seven-stage pipeline, including constraint extraction and an iterative generation-validation-repair loop, to improve testing stability and context management. Experiments on PyTorch and TensorFlow show that ATTest achieves significantly higher branch coverage than PynguinML, reaching 55.60% and 54.77% respectively.
LLM-powered test generation can finally achieve meaningful coverage in deep learning libraries, thanks to a novel agent-driven framework that iteratively refines tests based on constraint validation.
The unit testing of Deep Learning (DL) libraries is challenging due to complex numerical semantics and implicit tensor constraints. Traditional Search-Based Software Testing (SBST) often suffers from semantic blindness, failing to satisfy the constraints of high-dimensional tensors, whereas Large Language Models (LLMs) struggle with cross-file context and unstable code modifications. This paper proposes ATTest, an agent-driven tensor testing framework for module-level unit test generation. ATTest orchestrates a seven-stage pipeline, which encompasses constraint extraction and an iterative "generation-validation-repair" loop, to maintain testing stability and mitigate context-window saturation. An evaluation on PyTorch and TensorFlow demonstrates that ATTest significantly outperforms state-of-the-art baselines such as PynguinML, achieving an average branch coverage of 55.60% and 54.77%, respectively. The results illustrate how agent-driven workflows bridge the semantic gap in numerical libraries while ensuring auditable test synthesis. Source code: https://github.com/iSEngLab/ATTest.git