Search papers, labs, and topics across Lattice.
This paper introduces InsightEmb, a contrastive embedding framework designed for agentic insight retrieval that focuses on aligning concrete situations with abstract heuristic rules to resolve decision bottlenecks in self-improving agents. By leveraging mathematical reasoning data, InsightEmb learns a transferable progress-oriented retrieval geometry that clusters reasoning trajectories with similar progress structures. The framework outperforms existing reasoning embedding models across dynamic agent tasks and static skill-retrieval benchmarks, demonstrating its effectiveness without requiring environment-specific training.
InsightEmb reveals that the geometry of state-insight matching can be effectively transferred across domains, enhancing decision-making in self-improving agents.
Self-improving agents accumulate reusable insights from prior trajectories, making retrieval increasingly important for turning accumulated experience into actionable guidance. At each decision step, retrieving the right insight can help the agent progress toward its goal, a setting we refer to as agentic insight retrieval. However, existing retrieval methods primarily model semantic similarity, while overlooking whether a retrieved insight resolves the agent's current decision bottleneck. We propose InsightEmb, a contrastive embedding framework that learns transferable progress-oriented retrieval geometry using only mathematical reasoning data. InsightEmb jointly learns to align concrete situations with abstract heuristic rules and to cluster reasoning trajectories with similar progress structures. We evaluate InsightEmb on dynamic agent tasks and a static skill-retrieval benchmark. Without any environment-specific training, InsightEmb improves over all these evaluations, surpassing the performance of existing reasoning embedding models. These results suggest that the geometry of state-insight matching can transfer across domains, enabling effective training from publicly available reasoning data without expensive environment-specific supervision.
