Search papers, labs, and topics across Lattice.
This paper introduces a novel training technique that combines a Generative Predictive Coding Network (PCN) with a support Encoding PCN, allowing for parallel updates and eliminating the bottleneck of sequential backwards error propagation. The method is applied to time series forecasting and anomaly detection, demonstrating that it enables more stable and continuous online learning compared to traditional approaches. Key results indicate significant improvements in both accuracy and efficiency in detecting anomalies in time series data.
Parallelizing predictive coding training can revolutionize how we approach time series forecasting and anomaly detection, leading to more robust online learning systems.
Predictive Coding (PC) is a neural learning paradigm that enables parallelizable neural network layer updates. However, the main bottleneck of PC Networks (PCN) is the sequential backwards error propagation. To tackle this, we introduce a training technique that pairs a Generative PCN with a support Encoding PCN. The two PCNs are trained in parallel to match their neural activations, without sequential propagation. We apply this to time series anomaly detection and show that our approach results in more stable, continuous, online learning.
