Large AI Model-Based Semantic Communications
This work addresses challenges in semantic communication for applications like metaverse and IoT, but it is incremental as it builds on existing large AI models and focuses on a specific domain.
The paper tackles the problem of constructing knowledge bases in semantic communication systems for image data, which face issues like limited representation and insecure sharing, by proposing a large AI model-based framework (LAM-SC) that uses segment anything model-based knowledge bases and adaptive compression, demonstrating effectiveness in simulations with reduced communication overhead.
Semantic communication (SC) is an emerging intelligent paradigm, offering solutions for various future applications like metaverse, mixed reality, and the Internet of Everything. However, in current SC systems, the construction of the knowledge base (KB) faces several issues, including limited knowledge representation, frequent knowledge updates, and insecure knowledge sharing. Fortunately, the development of the large AI model (LAM) provides new solutions to overcome the above issues. Here, we propose a LAM-based SC framework (LAM-SC) specifically designed for image data, where we first apply the segment anything model (SAM)-based KB (SKB) that can split the original image into different semantic segments by universal semantic knowledge. Then, we present an attention-based semantic integration (ASI) to weigh the semantic segments generated by SKB without human participation and integrate them as the semantic aware image. Additionally, we propose an adaptive semantic compression (ASC) encoding to remove redundant information in semantic features, thereby reducing communication overhead. Finally, through simulations, we demonstrate the effectiveness of the LAM-SC framework and the possibility of applying the LAM-based KB in future SC paradigms.