Search papers, labs, and topics across Lattice.
This paper addresses the synthesis of optimal policies for planning in Markov decision processes (MDPs) with objectives and safety constraints defined by co-safe linear temporal logic (sc-LTL). By reducing the complex sc-LTL planning problem to a constrained reachability problem, the authors introduce a class of switching policies derived from stationary policies that achieve optimality. The effectiveness of this approach is validated through a grid world case study, which illustrates the optimal trade-off between objectives and safety constraints while ensuring computational tractability.
Switching policies derived from stationary policies can achieve optimality in constrained sc-LTL planning, balancing objectives and safety like never before.
We study the synthesis of optimal policies for planning problems on Markov decision processes with both objectives and safety constraints specified in co-safe linear temporal logic (sc-LTL). Our problems are inherently non-Markovian due to the complexity of the sc-LTL specification and may require policy randomization to balance the objective and constraint. We propose a novel approach that reduces the constrained sc-LTL planning problem to a constrained reachability problem on an extended model. We then show that a class of switching policies constructed from stationary policies for the individual sc-LTL specifications is sufficient for optimality for the constrained reachability problem. Our finding enables a tractable linear program to compute the optimal policy. A grid world case study demonstrates that our switching policies can achieve the optimal trade-off between the objective and the safety constraint and validates both optimality and tractability.
