Search papers, labs, and topics across Lattice.
The paper proposes a doubly adaptive deep joint source-channel coding (DA-DJSCC) method for semantic image communication in IoT networks, addressing limitations in bandwidth, computation, and energy. DA-DJSCC incorporates both channel-wise and spatial attention modules at the transmitter and receiver to dynamically adapt to varying channel conditions and spatial feature importance. Simulation results demonstrate that DA-DJSCC significantly improves upon SNR Adaptive DJSCC (ADJSCC) in performance while maintaining low complexity, making it suitable for resource-constrained IoT devices.
Achieve superior semantic image communication in IoT networks by dynamically adapting to channel conditions and spatial feature importance with a novel doubly adaptive attention mechanism.
Internet of Things (IoT) networks face significant challenges such as limited communication bandwidth, constrained computational and energy resources, and highly dynamic wireless channel conditions. Utilization of deep neural networks (DNNs) combined with semantic communication has emerged as a promising paradigm to address these limitations. Deep joint source-channel coding (DJSCC) has recently been proposed to enable semantic communication of images. Building upon the original DJSCC formulation, low-complexity attention-style architectures has been added to the DNNs for further performance enhancement. As a main hurdle, training these DNNs separately for various signal-to-noise ratios (SNRs) will amount to excessive storage or communication overhead, which can not be maintained by small IoT devices. SNR Adaptive DJSCC (ADJSCC), has been proposed to train the DNNs once but feed the current SNR as part of the data to the channel-wise attention mechanism. We improve upon ADJSCC by a simultaneous utilization of doubly adaptive channel-wise and spatial attention modules at both transmitter and receiver. These modules dynamically adjust to varying channel conditions and spatial feature importance, enabling robust and efficient feature extraction and semantic information recovery. Simulation results corroborate that our proposed doubly adaptive DJSCC (DA-DJSCC) significantly improves upon ADJSCC in several performance criteria, while incurring a mild increase in complexity. These facts render DA-DJSCC a desirable choice for semantic communication in performance demanding but low-complexity IoT networks.
