Search papers, labs, and topics across Lattice.
This study introduces a novel approach to robust dexterous grasping by formulating grasp acquisition as variational inference over latent contact parameters and object pose, utilizing a differentiable Gaussian mixture to represent beliefs. By employing Gumbel-Softmax component selection and a differentiable CVaR surrogate, the method enables efficient optimization of tail robustness in the presence of multimodal uncertainties. The results demonstrate significant improvements in grasp success rates and planning efficiency, achieving better performance than traditional particle-filter methods while maintaining lower calibration errors in risk assessment.
Variational neural belief parameterizations can drastically enhance grasping success rates and reduce planning time under multimodal uncertainties, outperforming traditional methods by an order of magnitude.
Contact variability, sensing uncertainty, and external disturbances make grasp execution stochastic. Expected-quality objectives ignore tail outcomes and often select grasps that fail under adverse contact realizations. Risk-sensitive POMDPs address this failure mode, but many use particle-filter beliefs that scale poorly, obstruct gradient-based optimization, and estimate Conditional Value-at-Risk (CVaR) with high-variance approximations. We instead formulate grasp acquisition as variational inference over latent contact parameters and object pose, representing the belief with a differentiable Gaussian mixture. We use Gumbel-Softmax component selection and location-scale reparameterization to express samples as smooth functions of the belief parameters, enabling pathwise gradients through a differentiable CVaR surrogate for direct optimization of tail robustness. In simulation, our variational neural belief improves robust grasp success under contact-parameter uncertainty and exogenous force perturbations while reducing planning time by roughly an order of magnitude relative to particle-filter model-predictive control. On a serial-chain robot arm with a multifingered hand, we validate grasp-and-lift success under object-pose uncertainty against a Gaussian baseline. Both methods succeed on the tested perturbations, but our controller terminates in fewer steps and less wall-clock time while achieving a higher tactile grasp-quality proxy. Our learned belief also calibrates risk more accurately, keeping mean absolute calibration error below 0.14 across tested simulation regimes, compared with 0.58 for a Cross-Entropy Method planner.
