Search papers, labs, and topics across Lattice.
This paper introduces Hypothesis-Driven Skill Optimization (HDSO), a framework that enhances action-oriented LLM agents by allowing skill updates without modifying model weights. By employing a train-free approach where both the skill curator and executor remain fixed, HDSO validates candidate skills through a structured hypothesis-testing process, resulting in significant performance improvements on the ALFWorld benchmark. The method demonstrates resilience against noisy feedback, maintaining a substantial skill gain even under adverse conditions, thereby establishing a robust skill lifecycle for LLM agents.
HDSO boosts LLM agent performance by 6.9 points on ALFWorld while ensuring skill updates are rigorously validated against noisy feedback.
External skills can improve action-oriented LLM agents without changing model weights, but persistent skill updates are risky when they are distilled from sparse or noisy trajectories. A plausible reflection may encode a useful procedure, a spurious shortcut, or a rule that the target executor cannot reliably follow. We propose Hypothesis-Driven Skill Optimization (HDSO), a train-free framework in which both the skill curator and the agent executor are frozen inference endpoints. The curator observes executor traces, proposes a falsifiable hypothesis with an explicit validation plan, instantiates the hypothesis as a candidate skill package, validates the package through paired control/treatment executions, reviews behavior differences, and consolidates only supported candidates into an approved repository. The executor consumes approved skills through progressive disclosure, preserving the executor-only path when no skill is selected. On ALFWorld, HDSO improves executor-only baselines by +6.9 Avg. SR points for Qwen3-8B and +4.0 points for Qwen3.6-27B. Under 20% randomly flipped success/failure feedback during skill discovery and validation, HDSO preserves a +7.1-point gain for Qwen3-8B. Transfer and heterogeneous-pair diagnostics further show that validated repositories can be useful beyond the run that produced them, but cross-model curation succeeds only when curator diagnosis, executor capability, and validation evidence align. HDSO provides an auditable skill lifecycle for frozen action agents rather than an unconstrained memory accumulation procedure.
