Search papers, labs, and topics across Lattice.
This paper introduces a parameter-efficient neural differential equation (DE) solver based on Horner-factorized polynomials, enabling implicit and differentiable trial solutions with minimal learnable parameters. By exactly enforcing initial conditions and training only on the DE residual at collocation points, the method achieves high accuracy with very few parameters. A piecewise extension further improves accuracy by training multiple small Horner models on subintervals while enforcing continuity at segment boundaries, outperforming MLP and sinusoidal baselines.
Achieve state-of-the-art accuracy in solving differential equations with neural networks using *fewer than ten* parameters by representing solutions as Horner-factorized polynomials.
We propose a parameter-minimal neural architecture for solving differential equations by restricting the hypothesis class to Horner-factorized polynomials, yielding an implicit, differentiable trial solution with only a small set of learnable coefficients. Initial conditions are enforced exactly by construction by fixing the low-order polynomial degrees of freedom, so training focuses solely on matching the differential-equation residual at collocation points. To reduce approximation error without abandoning the low-parameter regime, we introduce a piecewise ("spline-like") extension that trains multiple small Horner models on subintervals while enforcing continuity (and first-derivative continuity) at segment boundaries. On illustrative ODE benchmarks and a heat-equation example, Horner networks with tens (or fewer) parameters accurately match the solution and its derivatives and outperform small MLP and sinusoidal-representation baselines under the same training settings, demonstrating a practical accuracy-parameter trade-off for resource-efficient scientific modeling.
