Doubly Adaptive Channel and Spatial Attention for Semantic Image Communication by IoT Devices
This work addresses the problem of efficient and robust semantic image communication for resource-constrained IoT devices, offering an incremental improvement over existing methods.
IoT devices face challenges in semantic image communication due to limited bandwidth and resources. This paper proposes Doubly Adaptive DJSCC (DA-DJSCC), which uses adaptive channel and spatial attention modules at both the transmitter and receiver to dynamically adjust to varying channel conditions and spatial feature importance. Simulation results show that DA-DJSCC significantly improves performance over existing ADJSCC with only a mild increase in complexity.
Internet of Things (IoT) networks face significant challenges such as limited communication bandwidth, constrained computational and energy resources, and highly dynamic wireless channel conditions. Utilization of deep neural networks (DNNs) combined with semantic communication has emerged as a promising paradigm to address these limitations. Deep joint source-channel coding (DJSCC) has recently been proposed to enable semantic communication of images. Building upon the original DJSCC formulation, low-complexity attention-style architectures has been added to the DNNs for further performance enhancement. As a main hurdle, training these DNNs separately for various signal-to-noise ratios (SNRs) will amount to excessive storage or communication overhead, which can not be maintained by small IoT devices. SNR Adaptive DJSCC (ADJSCC), has been proposed to train the DNNs once but feed the current SNR as part of the data to the channel-wise attention mechanism. We improve upon ADJSCC by a simultaneous utilization of doubly adaptive channel-wise and spatial attention modules at both transmitter and receiver. These modules dynamically adjust to varying channel conditions and spatial feature importance, enabling robust and efficient feature extraction and semantic information recovery. Simulation results corroborate that our proposed doubly adaptive DJSCC (DA-DJSCC) significantly improves upon ADJSCC in several performance criteria, while incurring a mild increase in complexity. These facts render DA-DJSCC a desirable choice for semantic communication in performance demanding but low-complexity IoT networks.