Search papers, labs, and topics across Lattice.
The Sparse Orthogonal Regression Technique (SORT) introduces a novel spectral framework that learns orthonormal-basis expansions from noisy and irregularly sampled data using L1-regularized regression, effectively bypassing the need for explicit quadrature or analytic inner-product evaluations. This method excels in data-driven discovery of ordinary differential equations by representing vector fields in tailored orthogonal bases, leading to sparse coefficient expansions that enhance model robustness against sampling noise and representation mismatches. Experimental results demonstrate that SORT not only matches but often surpasses traditional library-based sparse regression methods, particularly when the basis is well-suited to the specific problem, while also supporting nonlinear approximation and high-dimensional integral estimation.
SORT shifts the focus from brittle term selection to adaptive basis design, enabling more robust and accurate equation discovery from noisy data.
We develop the Sparse Orthogonal Regression Technique (SORT), a sparse spectral framework for learning orthonormal-basis expansions from noisy and irregularly sampled data. SORT estimates expansion coefficients directly from observations using L1-regularized regression, avoiding explicit quadrature or analytic inner-product evaluation. The central application is data-driven discovery of ordinary differential equations: vector fields are represented in chosen orthogonal bases and learned as sparse coefficient expansions. This provides a complementary route to symbolic regression, grammar-based discovery, and SINDy-style sparse identification by first recovering a compact spectral representation, which can later guide searches for simpler analytic forms. Across the dynamical-system experiments, SORT matches or improves upon library-based sparse-regression baselines when the basis is well adapted to the problem, and shows more stable degradation under sparse sampling, noisy derivative estimates, and representation mismatch. Specific examples illustrate why this representation is useful: if a finite library misses the problem-specific nonlinearity, the resulting model can fail. SORT is not immune to mismatch, but it shifts the problem away from brittle selection among generic terms to basis design adapted to the problem domain. The experiments also show that dominant low-order coefficients persist as model order increases, supporting order-consistent model growth. Beyond equation discovery, the same learned expansion supports nonlinear approximation and estimation of complex, high-dimensional integrals by coefficient readout. Overall, SORT provides a reusable intermediate representation for system identification, approximation, and integration, while making basis design an explicit part of the scientific modeling problem.
