Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a stratification-based semantics for Signal Temporal Logic (STL), interpreting atomic predicates as membership tests in a stratified space. It establishes a correspondence between stratification theory and STL, demonstrating that STL formulas induce a stratification of space-time. The authors then apply this framework to analyze the latent embeddings of DRL agents in Minigrid games, using STL robustness as a reward signal and proposing efficient signatures for uncovering stratification structures.
STL formulas can reveal the hidden structure of DRL agent embeddings, offering a new lens for understanding and analyzing learned representations.
In this paper, we develop a stratification-based semantics for Signal Temporal Logic (STL) in which each atomic predicate is interpreted as a membership test in a stratified space. This perspective reveals a novel correspondence principle between stratification theory and STL, showing that most STL formulas can be viewed as inducing a stratification of space-time. The significance of this interpretation is twofold. First, it offers a fresh theoretical framework for analyzing the structure of the embedding space generated by deep reinforcement learning (DRL) and relates it to the geometry of the ambient decision space. Second, it provides a principled framework that both enables the reuse of existing high-dimensional analysis tools and motivates the creation of novel computational techniques. To ground the theory, we (1) illustrate the role of stratification theory in Minigrid games and (2) apply numerical techniques to the latent embeddings of a DRL agent playing such a game where the robustness of STL formulas is used as the reward. In the process, we propose computationally efficient signatures that, based on preliminary evidence, appear promising for uncovering the stratification structure of such embedding spaces.