Search papers, labs, and topics across Lattice.
This paper introduces ReLViC, a novel learned video coding framework designed to mitigate the adverse effects of packet loss by dispersing latent tokens across packets and employing a dual-purpose Transformer for both entropy modeling and token recovery. The framework allows for adjustable packet dependencies, enabling a balance between compression efficiency and error propagation without the need for retraining. Experimental results demonstrate that ReLViC achieves superior reconstruction stability and outperforms traditional codecs like H.265 with Reed-Solomon FEC and the GRACE codec under severe packet loss conditions.
ReLViC achieves robust video coding by dispersing latent tokens, outperforming established codecs even in the face of severe packet loss.
Packet loss can severely impair learned video coding because missing latent tokens compromise both spatial reconstruction and temporal prediction. We present ReLViC, a loss-resilient learned video coding framework that jointly addresses latent coding and packet-loss recovery. ReLViC disperses spatially adjacent latent tokens across packets and employs a dual-purpose Transformer to estimate entropy-model parameters during coding and reconstruct missing latent tokens at the receiver. It controls packet dependencies through a periodic-reset packet-context topology parameterized by the segment length, thereby tuning the trade-off between compression efficiency and error-propagation range without retraining. A three-stage progressive training procedure establishes single-frame coding, learns temporal context for entropy modeling, and then optimizes the recovery of masked latent tokens under simulated packet loss. Experiments using burst-loss traces evaluate ReLViC against H.265 protected by Reed--Solomon forward error correction (FEC) and GRACE, a loss-resilient learned video codec. ReLViC delivers more stable reconstruction and outperforms both baselines under severe packet loss.
