Search papers, labs, and topics across Lattice.
This paper introduces G-MARK, a novel framework for cooperative driving that utilizes grounded multi-agent reasoning through the construction of provenance-aware knowledge graphs (KGs). By explicitly representing object-centric observations and their sources, G-MARK enhances the visibility of critical information, allowing for improved reasoning about occluded objects and conflicts among agents. The framework demonstrates significant performance improvements, including a 42.2% increase in occlusion reasoning accuracy and a 13.1% reduction in control-selection errors, while also minimizing communication payloads by 25.6 times compared to state-of-the-art methods.
G-MARK reveals that grounding multi-agent reasoning in provenance-aware knowledge graphs can drastically enhance occlusion reasoning and decision-making in cooperative driving.
Autonomous driving systems must operate under partial observability, where safety-critical objects may be occluded or visible only to neighboring connected vehicles. Vehicle-to-vehicle cooperation can reduce this uncertainty, but existing cooperative driving methods often compress multi-agent evidence into latent features or hidden multimodal states. As a result, they obscure which agent observed each object, whether the object is visible to the ego vehicle, and how conflicting evidence affects downstream decisions. We propose G-MARK, a grounded multi-agent reasoning framework that converts cooperative object-centric observations into explicit provenance-aware knowledge graphs (KGs). The resulting KGs preserve object hypotheses together with their source attribution, ego-versus-partner visibility, uncertainty, conflicts, spatial relations, and planning-relevant context. G-MARK then derives a shared feature representation from these KGs, enabling lightweight task heads to support object reasoning, motion prediction, control selection, and trajectory forecasting. Compared with the state-of-the-art baseline, GMARK improves occlusion reasoning accuracy by 42.2%, reduces control-selection error by 13.1%, and achieves comparable trajectory-planning accuracy with a 25.6x smaller structured communication payload. Our code is available at https://github.com/bhavyagupta98/g-mark.
