Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a generalized reward function for Multi-Agent Reinforcement Learning (MARL) in the context of multi-agent spacecraft inspection, moving beyond fixed inspection points to allow for dynamic image collection based on 3D reconstructions. By enabling agents to determine the optimal timing and locations for image capture, the study enhances the flexibility and effectiveness of MARL in orbital inspections. Key findings reveal best practices that not only improve MARL performance but also provide valuable insights applicable to broader inspection tasks beyond the MARL framework.
Generalized reward functions in MARL can significantly enhance the adaptability and efficiency of multi-agent spacecraft inspections, allowing agents to optimize image collection in real-time.
A proposed method for the control of groups of inspection spacecraft is Multi-Agent Reinforcement Learning (MARL). While MARL has already been employed for this purpose in previous work, the reward functions used focus on reaching a finite set of predetermined inspection points around the target. In this work, we study and develop a generalized reward function for the MARL inspection task informed by the analysis of 3D reconstructions of inspected objects in orbit. Because the reward function is generalized such that any number of images at arbitrary locations may evaluated, we also allow trained agents to have complete control over when images are collected. With this approach, we gather insights into best practices for not only the specific MARL inspection task, but also gain key takeaways informative to the broader inspection task outside of a MARL context.