Search papers, labs, and topics across Lattice.
This paper analyzes the risks of using Large Language Models in pedestrian navigation, highlighting potential for manipulation and misplaced trust through dark patterns and explainability pitfalls. It categorizes these risks using a 2x2 framework based on intent and origin (intentional manipulations vs. unintended harms). The authors propose seamful design strategies and neuro-symbolic architectures to mitigate these harms by grounding GenAI's persuasive capabilities with verifiable pathfinding algorithms.
Conversational navigation powered by LLMs risks becoming a manipulative dialogue, but can be made trustworthy by grounding it in verifiable pathfinding algorithms.
As pedestrian navigation increasingly experiments with Generative AI, and in particular Large Language Models, the nature of routing risks transforming from a verifiable geometric task into an opaque, persuasive dialogue. While conversational interfaces promise personalisation, they introduce risks of manipulation and misplaced trust. We categorise these risks using a 2x2 framework based on intent and origin, distinguishing between intentional manipulations (dark patterns) and unintended harms (explainability pitfalls). We propose seamful design strategies to mitigate these harms. We suggest that one robust way to operationalise trustworthy conversational navigation is through neuro-symbolic architecture, where verifiable pathfinding algorithms ground GenAI's persuasive capabilities, ensuring systems explain their limitations and incentives as clearly as they explain the route.
