Search papers, labs, and topics across Lattice.
This paper introduces an explorer agent that systematically navigates the query space of GUI environments to identify user-sensitive states, which are crucial for ensuring user safety during task automation. By categorizing these states and defining user-sensitive queries, the agent enables a more reliable handover to users when sensitive information is involved. The key result demonstrates that this approach significantly enhances the safety and reliability of LLM-driven agents in real-world applications by preventing unintended actions on sensitive data.
User-sensitive states in GUI environments can be identified and managed by an explorer agent, drastically improving the safety of LLM task automation.
LLM agents are increasingly being used to automate tasks for users within an open GUI environment. They inevitably encounter screens containing user-sensitive information, for which takeover of task execution by the user is highly desirable or even necessary. State-of-the-art LLM-driven agents are usually fine-tuned to complete tasks regardless of the safety implications of their actions. This makes their real-world deployment difficult and adversely affects the reliability. Therefore, it is crucial to identify and categorize user-sensitive states and define user-sensitive queries. This dataset would be to engineers to recognize and request handover to the user in critical scenarios. This short paper develops an explorer agent that systematically explores the query space starting from one demonstrated task to identify queries that, if executed, would lead to user-sensitive states in a GUI environment.
