Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Standard reinforcement learning for long-horizon agents relies on static rubrics and fixed task distributions that fail to adapt as an agent outgrows early weaknesses, leaving policies prone to repetitive failure modes under sparse feedback. ARISE addresses this by dynamically co-evolving intermediate evaluation rubrics, targeted exploration skills, and capability-based task sampling based on policy rollout evidence. Evaluated on SkillsBench and Terminal-Bench, this adaptive paradigm substantially improves sample efficiency and task completion across multi-step agent environments.
Long-horizon agent RL frequently stalls because fixed rewards cannot track shifting bottlenecks—co-evolving evaluation rubrics with targeted exploration skills directly breaks the repetitive failure loops of current policies.
As a long-horizon agent improves through experience, previously observed weaknesses may recede while new limitations emerge, continually changing what it still needs to learn. Yet the learning process often remains tied to a static view of these needs: fixed behavioral criteria and training priorities can become misaligned with evolving agent capabilities, while sparse task-level feedback makes such misalignment more difficult to detect. Even when capability gaps are identified, rollouts from the current policy may repeatedly reproduce the same failures rather than explore better alternatives. To address this, we introduce Adaptive Rubric-Skill Co-Evolution (ARISE), a reinforcement learning framework that uses rollout evidence to continually adapt evaluation criteria, exploration guidance, and training priorities. Rubrics evolve to reward partial behavioral progress, while their paired skills are refined and selectively activated to guide exploration toward unresolved weaknesses. Alongside this co-evolution, capability-based adaptive sampling prioritizes tasks that target behaviors needing further improvement. Experiments on two challenging long-horizon agent benchmarks, SkillsBench and Terminal-Bench, demonstrate that ARISE successfully enhances both overall task performance and training efficiency. The project page is at https://foundation-model-research.github.io/ARISE .