SemanticNN: Compressive and Error-Resilient Semantic Offloading for Extremely Weak Devices
This addresses the problem of efficient and resilient AI offloading for resource-constrained IoT devices, offering a novel approach that is incremental in improving device-edge collaboration.
The paper tackles the challenge of AI inference offloading for extremely weak IoT devices under unreliable network conditions by proposing SemanticNN, a semantic codec that tolerates bit-level errors to achieve semantic-level correctness, resulting in a 56.82-344.83x reduction in feature transmission volume while maintaining high inference accuracy.
With the rapid growth of the Internet of Things (IoT), integrating artificial intelligence (AI) on extremely weak embedded devices has garnered significant attention, enabling improved real-time performance and enhanced data privacy. However, the resource limitations of such devices and unreliable network conditions necessitate error-resilient device-edge collaboration systems. Traditional approaches focus on bit-level transmission correctness, which can be inefficient under dynamic channel conditions. In contrast, we propose SemanticNN, a semantic codec that tolerates bit-level errors in pursuit of semantic-level correctness, enabling compressive and resilient collaborative inference offloading under strict computational and communication constraints. It incorporates a Bit Error Rate (BER)-aware decoder that adapts to dynamic channel conditions and a Soft Quantization (SQ)-based encoder to learn compact representations. Building on this architecture, we introduce Feature-augmentation Learning, a novel training strategy that enhances offloading efficiency. To address encoder-decoder capability mismatches from asymmetric resources, we propose XAI-based Asymmetry Compensation to enhance decoding semantic fidelity. We conduct extensive experiments on STM32 using three models and six datasets across image classification and object detection tasks. Experimental results demonstrate that, under varying transmission error rates, SemanticNN significantly reduces feature transmission volume by 56.82-344.83x while maintaining superior inference accuracy.