Search papers, labs, and topics across Lattice.
This paper introduces PEC-Home, a novel simulated dataset aimed at improving the interpretation of progressively elliptical commands in smart home environments. The research highlights that current large language models (LLMs) fail to accurately execute user-intended operations when relying solely on elliptical expressions, which are common in human dialogue as context accumulates. Experiments reveal that even advanced models like GPT-4o struggle with execution accuracy, underscoring the need for better handling of referential and intention ambiguity in smart home interactions.
Existing smart home assistants miss user intentions in 60% of cases when interpreting elliptical commands, revealing a critical gap in their design.
Recent advancements in Large Language Models (LLMs) have empowered home assistants with natural language interaction capabilities. However, current assistants overlook the progressive omission that occurs in human dialogue as shared context accumulates, leading to more elliptical expressions for efficient communication. Thus, current assistants still struggle to interpret such elliptical expressions accurately, which limits their effectiveness in real-world applications. In practical smart home scenarios, assistants face two major challenges caused by elliptical commands: (1) referential ambiguity caused by different environmental expectations among multiple users; and (2) intention ambiguity resulting from user preferences that evolve over time or change with the environment. To address these challenges, we introduce PEC-Home, the first simulated home dataset specifically designed for interpreting progressively elliptical commands in smart homes. Extensive experiments on various LLMs, including GPT-4o, show that existing home assistants struggle to execute user-intended operations based solely on elliptical commands. Even when equipped with tools for storing and retrieving user dialogue history, execution accuracy remains below that achieved with complete commands.}.
