Search papers, labs, and topics across Lattice.
This paper revisits max-policy iteration, demonstrating that it can effectively replace costly mathematical optimization with plain value iteration while maintaining guaranteed termination. The authors provide a precise bound analysis for both integer and floating-point variables, eliminating the need for widening operators. Additionally, they introduce min-policy iteration as a viable alternative to linear programming for solving optimization problems, proving its effectiveness for both bounded and unbounded systems.
Replacing expensive mathematical optimization with value iteration in max-policy iteration could revolutionize how we compute program invariants.
Max-policy iteration is an approach to computing precise numeric program invariants by successive attempts at resolving maximum operators and reduction to mathematical optimization. Mathematical optimization, though, may be expensive. Here, we show, for max-policy iteration on systems of equations over integers as well as over floating point numbers, that mathematical optimization can be replaced by plain value iteration -- which is still guaranteed to terminate. As an application, a precise bound analysis for integer or floating point variables is obtained, avoiding widening operators altogether. We also consider max-policy iteration over the rational numbers, where the right-hand sides are maxima of minima of affine combinations of unknowns. We propose min-policy iteration as an alternative to linear programming for solving the optimization problems posed by max-policy iteration. We prove that max-min policy iteration is guaranteed to return the least solution for bounded systems. We also show how to extend this algorithm to unbounded systems, and how to construct certificates of soundness as well as of optimality of the computed results.
