Search papers, labs, and topics across Lattice.
The paper introduces the Amortized Predictability-aware Training Framework (APTF) to address the issue of low-predictability samples causing training instability in time series forecasting (TSF) and classification (TSC). APTF employs a Hierarchical Predictability-aware Loss (HPL) to dynamically identify and penalize low-predictability samples, coupled with an amortization model to correct predictability estimation errors. Experiments demonstrate that APTF improves performance in both TSF and TSC by focusing training on more predictable data patterns.
Stop letting noisy, low-predictability data ruin your time series models: APTF dynamically identifies and penalizes these samples during training, leading to improved forecasting and classification accuracy.
Time series data are prone to noise in various domains, and training samples may contain low-predictability patterns that deviate from the normal data distribution, leading to training instability or convergence to poor local minima. Therefore, mitigating the adverse effects of low-predictability samples is crucial for time series analysis tasks such as time series forecasting (TSF) and time series classification (TSC). While many deep learning models have achieved promising performance, few consider how to identify and penalize low-predictability samples to improve model performance from the training perspective. To fill this gap, we propose a general Amortized Predictability-aware Training Framework (APTF) for both TSF and TSC. APTF introduces two key designs that enable the model to focus on high-predictability samples while still learning appropriately from low-predictability ones: (i) a Hierarchical Predictability-aware Loss (HPL) that dynamically identifies low-predictability samples and progressively expands their loss penalty as training evolves, and (ii) an amortization model that mitigates predictability estimation errors caused by model bias, further enhancing HPL's effectiveness. The code is available at https://github.com/Meteor-Stars/APTF.
