Search papers, labs, and topics across Lattice.
The paper introduces the concept of the "proactivity gap" in long-lived LLM agents, where agents fail to ask for reusable user preferences that are not immediately needed but could be valuable in future sessions. To quantify this gap, they present ATRBench, a benchmark that measures an agent's ability to "Ask-to-Remember" (ATR) user preferences for later use. Experiments on eight state-of-the-art LLM agents reveal a significant performance gap compared to an oracle with access to the user's preferences, highlighting acquisition as the primary bottleneck.
Today's LLM agents are surprisingly passive, missing opportunities to proactively learn and remember user preferences that could dramatically improve their long-term usefulness.
A long-lived LLM agent, such as OpenClaw, earns its value by acting on a user's preferences and constraints across sessions, not just the current request. Yet today's agents keep what a user volunteers but rarely ask for what stays unspoken, leaving a proactivity gap in long-lived LLM agents: an agent cannot act on a preference it never obtained. As users delegate more of their affairs to agents, the impact of this gap grows. We isolate one concrete, controllable slice of this gap as Ask-to-Remember (ATR): the agent decides whether to ask now for a reusable user preference that the current task does not need but a later session with the same user will. ATR is hard even to evaluate: the right question is underdetermined and its payoff deferred to tasks that may never arise. ATRBench, to the best of our knowledge the first ATR benchmark, makes it measurable by fixing each user's preferences as hidden ground truth, so success demands asking, not recall. Across eight frontier LLM agents, defaults fall at least 62 points below an oracle handed the relevant preference, and prompting closes little of it. Diagnostics identify acquisition as the bottleneck. ATRBench surfaces this proactivity gap in current agents and offers a diagnostic testbed for closing it.
