Search papers, labs, and topics across Lattice.
This paper addresses the challenge of learning operators from sequentially collected dependent data, which is crucial in fields like adaptive experimental design and Bayesian optimization. The authors derive time-uniform self-normalized concentration bounds for stochastic processes in Hilbert spaces, leading to regression-error guarantees for both linear and nonlinear parametric operators. This work significantly advances the understanding of convergence in adaptive operator learning, particularly in scenarios involving infinite-dimensional inputs and outputs without independence assumptions.
Regression-error guarantees for learning operators from dependent sequential data could revolutionize adaptive experimental design and Bayesian optimization.
Learning operators from sequentially collected data arises in adaptive experimental design, Bayesian optimization, and dynamical-system modelling, where observations may be dependent, and future inputs or sensing operators may depend on preceding data. We derive time-uniform self-normalized concentration bounds for stochastic processes in Hilbert spaces with vector-valued noise. We use these bounds to obtain regression-error guarantees for linear operators, including targets outside the Hilbert estimation space, and for nonlinear parametric operators trained with strongly convex losses and regularizers. Our results allow possibly infinite-dimensional inputs and outputs without independence or mixing assumptions, providing a major step towards convergence guarantees for adaptive operator learning and learning from stochastic dynamical data.
