Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To resolve the gap where retrieval-augmented driving models pull safety rules that are semantically relevant but factually inapplicable, the authors introduce a pre-decision symbolic verification stage using a Driving-Risk Knowledge Graph and Semantic Web Rule Language (SWRL). This neuro-symbolic pipeline deterministically checks whether rule antecedents are jointly satisfied by grounded scene facts and spatio-temporal entity bindings, passing only entailed risk relations to a downstream vision-language model and diffusion planner. Evaluated on nuReasoning, this grounded entailment approach outperforms traditional semantic retrieval baselines, boosting the driving planning score by 1.30 points and non-at-fault collision avoidance by 2.76 points.
Semantic relevance is a dangerously loose proxy for safety: replacing standard RAG with formal, scene-grounded rule entailment prevents vision-language planners from acting on ungrounded risk assumptions.
Retrieval-augmented generation (RAG) gives vision--language driving systems access to external safety knowledge, yet a retrieved risk rule may be relevant without applying to the current scene. A vision--language model (VLM) receiving such knowledge must ground objects, bind entities across time, and verify relations before deciding how to act, leaving the support for risk conclusions implicit. We address this relevance--applicability gap with a Driving-Risk Knowledge Graph (DRKG) and Semantic Web Rule Language (SWRL) reasoning stage before VLM decision-making. Structured perception instantiates scene facts, from which SWRL rules derive events and directed risk relations when their antecedents are jointly satisfied. Recognized events, bound risk relations, and semantic descriptions of activated rules form compact evidence that conditions the VLM and diffusion planner. In matched comparisons on nuReasoning, our method improved the nuReasoning planning score (NPS) by 1.30 points and the non-at-fault collision score (NC) by 2.76 points over the relevance retrieval-based baseline. These gains indicate that scene-applicable risk evidence improves safety-weighted planning relative to semantically retrieved risk knowledge.