Search papers, labs, and topics across Lattice.
This paper generalizes Voronoi regions into Cost-Induced Voronoi (CIV) regions, allowing for the integration of agent utility over these regions, which can differ in state space from the partitioned space. By applying this framework to a two-team soccer scenario, the authors define agent utility as the integral of a utility density—such as the probability of receiving a pass—and derive its gradient to optimize this probability. The method leverages the Reynolds Transport Theorem from fluid mechanics, achieving similar accuracy while reducing computation time by an order of magnitude compared to traditional finite-difference methods.
Integrating agent utility over generalized Voronoi regions can drastically improve decision-making efficiency in multi-agent systems, like soccer, by optimizing the probability of advantageous events.
In this paper, we generalize the concept of Voronoi regions, define agent utility as the integral of a utility density over the corresponding Voronoi region, derive gradients of the utility, and illustrate the approach in a two-team example from soccer. The generalization of Voronoi regions is in the form of so-called Cost-Induced Voronoi (CIV) regions, where the agent state space may differ from the space being partitioned. One example of such regions is when the cost is given by the optimal solution of an LQR control problem. Then the agent states include position as well as velocity, while the partitioned space only includes positions. The agent utility is defined by integrating some utility density over the CIV region of the agent. This utility density might be the probability density of some beneficial event, such as receiving a pass in soccer. The utility is then the overall probability of receiving a pass and the gradient represents a way to improve that probability. We show how this utility gradient can be computed using the Reynolds Transport Theorem from fluid mechanics, and that this approach achieves similar accuracy while reducing computation time by about an order of magnitude compared to a baseline finite-difference approximation.