Search papers, labs, and topics across Lattice.
This paper introduces a loss-resilient wireless video token communication (WVTC) framework designed to enhance video transmission over block fading channels by prioritizing token importance based on their predictive structure. By employing a shuffled mixed I/P-token packetization scheme and an online scheduling method that considers various factors such as packet importance density and decoding reliability, the framework effectively mitigates the impact of correlated token losses. Numerical evaluations show that WVTC significantly improves perceptual quality and maintains better performance under high packet error rates compared to traditional methods.
Prioritizing video token importance can dramatically enhance reconstruction quality, even in the face of severe packet loss.
Video token communication represents video content as discrete tokens that differ in their importance to reconstruction and exhibit temporal dependencies. When these tokens are packetized for wireless transmission, block fading can cause multiple important or correlated tokens to be lost together, severely degrading video reconstruction. To address this issue, we propose a loss-resilient wireless video token communication (WVTC) framework. WVTC evaluates token importance from the intrinsic predictive structure of video tokens, assigning high priority to structural I-tokens and measuring P-token importance by temporal neighborhood novelty. A shuffled mixed I/P-token packetization scheme disperses structural anchors and correlated temporal regions across packets. Using only current block channel state information, an online scheduler jointly considers packet importance density, MCS-dependent decoding reliability, block capacity, and importance concentration when allocating packets to fading blocks. At the receiver, a fine-tuned detokenizer reconstructs missing content from surviving tokens without retransmission. Numerical results demonstrate improved perceptual quality and more graceful degradation under increasing packet error rates.
