Search papers, labs, and topics across Lattice.
This paper introduces a neural network-based approach for estimating autoregressive (AR) model coefficients by embedding the AR structure within a feedforward network and using backpropagation for optimization. The method demonstrates superior convergence rates compared to Conditional Maximum Likelihood (CML), which fails to converge in approximately 55% of cases in their experiments on 125,000 synthetic AR(p) time series. The NN-based estimator also achieves significant computational speedups, reaching a median of 12.6x faster estimation, while maintaining comparable accuracy when CML converges.
Ditch slow, unstable AR estimation: neural nets offer a 12x speed boost and better convergence, without sacrificing interpretability.
Autoregressive (AR) models remain widely used in time series analysis due to their interpretability, but convencional parameter estimation methods can be computationally expensive and prone to convergence issues. This paper proposes a Neural Network (NN) formulation of AR estimation by embedding the autoregressive structure directly into a feedforward NN, enabling coefficient estimation through backpropagation while preserving interpretability. Simulation experiments on 125,000 synthetic AR(p) time series with short-term dependence (1<= p<= 5) show that the proposed NN-based method consistently recovers model coefficients for all series, while Conditional Maximum Likelihood (CML) fails to converge in approximately 55% of cases. When both methods converge, estimation accuracy is comparable with negligible differences in relative error, R2 and, perplexity/likelihood. However, when CML fails, the NN-based approach still provides reliable estimates. In all cases, the NN estimator achieves substantial computational gains, reaching a median speedup of 12.6x and up to 34.2x for higher model orders. Overall, results demonstrate that gradient-descent NN optimization can provide a fast and efficient alternative for interpretable AR parameter estimation.
