Search papers, labs, and topics across Lattice.
This paper introduces a strictly causal streaming anomaly detection system that updates its fixed-size state in constant time and memory per incoming frame, eliminating the need for buffering or lookahead. The method employs a diagonal linear state space recurrence with a decay gate, trained through self-supervised learning, and establishes a theoretical relationship between the decay spectrum and detection latency. Empirical validation on UCSD Ped2 and CUHK Avenue datasets shows promising latency performance on edge hardware, although accuracy lags behind non-causal state space model baselines, highlighting the need for further refinement and evaluation on larger datasets.
A causal streaming anomaly detector achieves real-time performance on edge hardware while revealing that detection responsiveness is governed more by an event boundary gate than by the base decay rate.
Recent work has applied Mamba style state space models (SSMs) to video anomaly detection, yet existing approaches still rely on buffering clips or windows internally, lack a theoretical account of how temporal memory relates to detection latency, and benchmark efficiency only through GPU throughput rather than the edge hardware these methods are intended to target. We introduce a strictly causal streaming anomaly detector whose fixed size state is updated in O(1) time and memory per incoming frame, with no lookahead and no clip buffering. Its temporal core is a diagonal linear state space recurrence with an input and state dependent decay gate, trained self supervised through causal next embedding prediction on a frozen visual backbone. We derive a closed form relationship between the recurrence decay spectrum and both detection delay and the shortest anomaly it can reliably capture, then validate empirically on UCSD Ped2 and CUHK Avenue. The settling delay bound predicted from the learned base decay (57 to 59 frames) sits far above the measured detection delay (1.6 and 18.4 frames), showing that the event boundary gate, not the base decay, governs responsiveness. We further report end to end latency and throughput measured directly on Apple M3 Pro hardware, 0.74 ms and 0.77 ms per frame (over 1300 FPS), rather than simulated GPU numbers. With an untuned initial configuration the method reaches 67.9 percent and 70.2 percent frame level AUC on Ped2 and Avenue, trailing prior non causal SSM baselines in accuracy. Ablations over decay rate, state size, and gating reveal that the gate contribution is dataset size dependent, hurting accuracy on the smaller Ped2 training set but helping on the larger Avenue one. Closing this accuracy gap and extending evaluation to a third, larger benchmark are immediate next steps.
