Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
HxAgent is an innovative iterative LLM-based planning agent designed for end-to-end web application testing that autonomously generates and executes test cases based on natural language functionality descriptions. It employs a proactive correction strategy, dynamically reassessing the web state after each action by leveraging current observations, short-term memory, and long-term experience from past actions. HxAgent achieves a remarkable 97.4% Exact-Match accuracy on the MiniWoB++ benchmark, outperforming existing methods like WALT by significant margins across various datasets.
HxAgent's proactive correction strategy enables it to achieve unprecedented accuracy in automated web testing without relying on human demonstrations.
In automated web testing, generating test cases and performing testing using functionality descriptions in natural-language is crucial for improving efficacy. These tasks require such a testing agent to carry out tasks on the target application and generating tests autonomously. We introduce HxAgent, an iterative LLM-based planning agent with a proactive correction strategy. After each step, HxAgent reassesses the web state to determine the next action using (1) current observations, (2) short-term memory of past actions, and (3) long-term experience extracted from past (in)correct sequences of actions. HxAgent achieves 97.4% Exact-Match accuracy on MiniWoB++, comparable to the best baselines without human demonstrations and surpassing the recent WALT by 10.5%. On a dataset of 350 web tasks, it attains 83.8% Exact-Match and 91.8% Prefix-Match, exceeding WALT by 13.4%. On OnlineMind2Web, it further improves over WALT by 4.6%.