Large AI Model-Enabled Generative Semantic Communications for Image Transmission
This work addresses image transmission efficiency for semantic communication systems, but it is incremental as it builds on existing generative AI methods with region-specific processing.
The paper tackles the problem of inefficient image transmission in semantic communication systems by segmenting images into key and non-key regions, using an image-oriented semantic encoder for key regions and image-to-text modeling for non-key regions, with results showing improved semantic fidelity and visual quality over traditional methods.
The rapid development of generative artificial intelligence (AI) has introduced significant opportunities for enhancing the efficiency and accuracy of image transmission within semantic communication systems. Despite these advancements, existing methodologies often neglect the difference in importance of different regions of the image, potentially compromising the reconstruction quality of visually critical content. To address this issue, we introduce an innovative generative semantic communication system that refines semantic granularity by segmenting images into key and non-key regions. Key regions, which contain essential visual information, are processed using an image oriented semantic encoder, while non-key regions are efficiently compressed through an image-to-text modeling approach. Additionally, to mitigate the substantial storage and computational demands posed by large AI models, the proposed system employs a lightweight deployment strategy incorporating model quantization and low-rank adaptation fine-tuning techniques, significantly boosting resource utilization without sacrificing performance. Simulation results demonstrate that the proposed system outperforms traditional methods in terms of both semantic fidelity and visual quality, thereby affirming its effectiveness for image transmission tasks.