Search papers, labs, and topics across Lattice.
GLMTest, a novel program structure-aware LLM framework, is introduced to improve targeted test case generation by integrating code property graphs and code semantics via a graph neural network. This allows conditioning test case generation on specific execution branches, enabling more controllable and targeted testing. Experiments on real-world projects demonstrate that GLMTest, built on Qwen2.5-Coder-7B-Instruct, significantly improves branch accuracy compared to state-of-the-art LLMs like Claude-Sonnet-4.5 and GPT-4o-mini, increasing it from 27.4% to 50.2% on the TestGenEval benchmark.
Steer LLMs toward high-risk code branches with 2x better accuracy using graph-structured code representations, unlocking more effective bug and vulnerability discovery.
Recent advances in large language models for test case generation have improved branch coverage via prompt-engineered mutations. However, they still lack principled mechanisms for steering models toward specific high-risk execution branches, limiting their effectiveness for discovering subtle bugs and security vulnerabilities. We propose GLMTest, the first program structure-aware LLM framework for targeted test case generation that seamlessly integrates code property graphs and code semantics using a graph neural network and a language model to condition test case generation on execution branches. This structured conditioning enables controllable and branch-targeted test case generation, thereby potentially enhancing bug and security risk discovery. Experiments on real-world projects show that GLMTest built on a Qwen2.5-Coder-7B-Instruct model improves branch accuracy from 27.4% to 50.2% on TestGenEval benchmark compared with state-of-the-art LLMs, i.e., Claude-Sonnet-4.5 and GPT-4o-mini.
