Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a probabilistic extension to the manifold meta-learning framework for low-dimensional neural system identification, addressing the challenges of overfitting and uncertainty quantification in low-data scenarios. By employing amortized Variational Inference, the method learns a generative prior over the parameter manifold and combines Maximum A Posteriori estimation with the Laplace approximation for task-specific adaptation. The approach demonstrates comparable predictive accuracy to deterministic methods while offering calibrated uncertainty bounds, significantly enhancing performance in low-data regimes.
A probabilistic approach to manifold meta-learning achieves high predictive accuracy while providing reliable uncertainty quantification in low-data environments.
Deep learning has proven highly effective for nonlinear system identification, but heavily parameterized neural networks are prone to overfitting in low-data regimes and lack reliable uncertainty quantification. The recently developed manifold meta-learning framework addresses the data efficiency problem by restricting the model parameters to a meta-learned low-dimensional manifold. However, that method is purely deterministic. We propose a fully probabilistic extension of the manifold meta-learning framework, based on amortized Variational Inference, where a generative prior over the low-dimensional parameter manifold is learned. During task-specific adaptation, we combine Maximum A Posteriori estimation with the Laplace approximation to yield a mathematically grounded posterior approximation. Evaluated on a static regression task and the Bouc--Wen dynamical system benchmark, the proposed approach achieves predictive accuracy comparable to its deterministic counterpart while successfully providing calibrated uncertainty bounds in severely low-data regimes.