Search papers, labs, and topics across Lattice.
This paper introduces a multi-goal prediction method that utilizes a Conditional Variational Autoencoder (CVAE) to anticipate diverse human movement intentions by integrating RGB scene data and human pose information. By addressing the stochastic nature of human behavior, the method allows for the generation of multiple potential future goals, enhancing the predictive capabilities of autonomous systems in dynamic environments. The results show significant generalization across different scenarios, validated on the GTA-IM and PROX datasets, underscoring the effectiveness of scene-aware predictions in human movement forecasting.
Predicting diverse human movement goals is now possible with a generative model that captures the stochastic nature of behavior in real-time environments.
Anticipation of human behaviours facilitates autonomous systems in proactive planning. Human behaviour could be stochastic due to varying goals. Human goals typically guide their own movement and could therefore help to predict the human trajectory and human motion in the long-term. To infer the human movement intentions, the environmental context plays a significant role, in addition to the social cues expressed by the individual. Previous works on human goals prediction either require semantic knowledge of the scene, or only tackle interactions with objects. In this paper, we propose a novel multi-goal prediction method using the generative model to address the stochasticity of human movement. It leverages the current RGB scene and the human pose to predict diverse potential future goals of human movement based on the Conditional Variational Autoencoder (CVAE). Our results demonstrate that our approach is capable of generating multiple movement goals in the scene via samplings in latent space of the CVAE and exhibits generalization capability across scenarios in GTA-IM dataset and PROX dataset. Code is publicly available at \href{https://github.com/Q-Y-Yang/DiverseGoalsPrediction.git}{\texttt{https://github.com/Q-Y-Yang/DiverseGoalsPrediction}}.
