Search papers, labs, and topics across Lattice.
This paper introduces MamVSC, a novel video semantic communication system that effectively addresses both semantic deviation and erasure distortions in extreme wireless conditions. By leveraging a CSI-guided semantic Mamba module, the system dynamically adjusts the granularity of semantic information extraction based on real-time channel feedback. The results demonstrate significant robustness, achieving an MS-SSIM greater than 0.6 and a PSNR exceeding 21 dB even under -8 dB SNR and 90% packet loss conditions.
Achieving robust video semantic communication under extreme conditions, MamVSC maintains high quality even with 90% packet loss and -8 dB SNR.
Semantic communication, leveraging joint source-channel coding, is designed to mitigate semantic distortion introduced by the channel. However, most current studies focus solely on semantic deviation distortion caused by physical wireless channels, while overlooking semantic erasure distortion due to packet loss. A CSI-Guided Mamba-based video semantic wireless digital communication system (MamVSC) employing semantic grouping is proposed to simultaneously address both semantic deviation and erasure distortions. In this system, a semantic Mamba module, guided by channel state information (CSI) feedback, is utilized to dynamically adjust the granularity of extracted semantic information, adapting to channel conditions. Furthermore, a Semantic Channel Codec based on dynamic Semantic clustering centers is introduced, where the distance between semantic vectors within the same semantic class and their corresponding Semantic clustering center is dynamically adjusted according to channel conditions, enhancing robustness against channel noise. Additionally, a adaptive packet loss recovery module, dynamically adaptive to the CSI, is proposed. The system achieves an MS-SSIM greater than 0.6 and a PSNR exceeding 21 dB at an SNR of -8 dB and a packet loss rate of 90% in AWGN channel.
