Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Anticipatory Reinforcement Learning (ARL), a framework that maps non-Markovian decision processes to a signature-augmented manifold to represent historical context as a dynamical coordinate. ARL uses a self-consistent field approach to maintain an anticipated proxy of the future path-law, enabling deterministic evaluation of expected returns and reducing computational complexity. The framework is proven to preserve contraction properties and ensures stable generalization, demonstrating superior policy stability in volatile environments.
By grounding reinforcement learning in the topological features of path-space, ARL enables agents to achieve proactive risk management and superior policy stability in highly volatile, continuous-time environments.
This paper introduces Anticipatory Reinforcement Learning (ARL), a novel framework designed to bridge the gap between non-Markovian decision processes and classical reinforcement learning architectures, specifically under the constraint of a single observed trajectory. In environments characterised by jump-diffusions and structural breaks, traditional state-based methods often fail to capture the essential path-dependent geometry required for accurate foresight. We resolve this by lifting the state space into a signature-augmented manifold, where the history of the process is embedded as a dynamical coordinate. By utilising a self-consistent field approach, the agent maintains an anticipated proxy of the future path-law, allowing for a deterministic evaluation of expected returns. This transition from stochastic branching to a single-pass linear evaluation significantly reduces computational complexity and variance. We prove that this framework preserves fundamental contraction properties and ensures stable generalisation even in the presence of heavy-tailed noise. Our results demonstrate that by grounding reinforcement learning in the topological features of path-space, agents can achieve proactive risk management and superior policy stability in highly volatile, continuous-time environments.