Search papers, labs, and topics across Lattice.
This study introduces task-specific preference adaptation for large language model (LLM) personalization, addressing the inefficiencies of universal preference summaries that often include irrelevant information for specific tasks. By employing a training-free meta-learning framework called AlignXada, the authors develop reusable textual refinement policies that optimize user preference summaries for individual tasks through verbal reinforcement learning. The results demonstrate significant performance improvements across 39 task-model combinations, achieving an average gain of 3.82 points while retaining only 22.8% of the original profile tokens, thus enhancing the relevance of personalized interactions in LLMs.
Task-specific preference adaptation can enhance LLM performance by refining user profiles to retain only the most relevant information for each task.
Natural language user preferences provide an interpretable interface for LLM personalization. However, universal preference summaries often contain information irrelevant to a particular downstream task. Directly supplying the full preference summary therefore wastes context capacity and introduces cross-task distraction, while manually designing task-specific preference views is difficult to scale. In this work, we study \emph{task-specific preference adaptation}: given a universal user preference summary and a downstream task, derive a task-conditioned representation that preserves sufficient decision-relevant evidence while removing redundant context. To this end, we propose \textsc{AlignXada}, a training-free meta-learning framework that induces reusable textual refinement policies for adapting universal preference summaries to task-specific ones. The refinement policy is iteratively optimized by a meta learner through verbal reinforcement learning. Across 13 tasks and three downstream models (39 task--model cells), \textsc{AlignXada} achieves an average gain of 3.82 points, improving 33 cells while retaining only 22.8\% of the original profile tokens and outperforming RAG in 36 cells. An extended faithfulness analysis further shows that the refined profiles remain largely grounded in the source preferences while preserving task-relevant personalization signals, suggesting that profile-side adaptation serves as a practical complement to universal memory construction for lifelong personalized agents.
