Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Differentiable Systematic Resampling (DSR), a novel relaxation of the discrete resampling step in particle filters that enables gradient-based learning for variational sequential Monte Carlo. DSR preserves the structural properties of systematic resampling while allowing for end-to-end training, achieving pointwise exponential convergence to the exact resampling policy with vanishing temperature. Empirical results demonstrate DSR's efficacy in state estimation and dynamics learning tasks, outperforming or matching existing methods with significantly reduced computational cost compared to optimal-transport-based approaches.
Gradient-based learning is now possible for variational sequential Monte Carlo without iterative solvers, thanks to a differentiable relaxation of systematic resampling.
Particle filters are a standard tool for nonlinear state estimation, but their resampling step is discrete, preventing gradient-based learning in variational sequential Monte Carlo. We introduce Differentiable Systematic Resampling (DSR), a temperature-controlled relaxation of systematic resampling, that preserves the CDF-ordered, banded structure of systematic resampling while enabling full gradient flow. DSR converges to exact systematic resampling as the temperature vanishes, and we prove a pointwise exponential convergence rate for the induced bias. Compared to optimal-transport-based differentiable resampling, DSR avoids iterative solvers and has substantially lower computational overhead. Experiments on stochastic dynamical systems and real-world handwriting data show that DSR achieves comparable or superior filtering and dynamics learning performance.