Jun Zhao

Xuyang Cao, Guoxin Wang, Sheng Shi et al.

Audio-driven portrait animation has made significant advances with diffusion-based models, improving video quality and lipsync accuracy. However, the increasing complexity of these models has led to inefficiencies in training and inference, as well as constraints on video length and inter-frame continuity. In this paper, we propose JoyVASA, a diffusion-based method for generating facial dynamics and head motion in audio-driven facial animation. Specifically, in the first stage, we introduce a decoupled facial representation framework that separates dynamic facial expressions from static 3D facial representations. This decoupling allows the system to generate longer videos by combining any static 3D facial representation with dynamic motion sequences. Then, in the second stage, a diffusion transformer is trained to generate motion sequences directly from audio cues, independent of character identity. Finally, a generator trained in the first stage uses the 3D facial representation and the generated motion sequences as inputs to render high-quality animations. With the decoupled facial representation and the identity-independent motion generation process, JoyVASA extends beyond human portraits to animate animal faces seamlessly. The model is trained on a hybrid dataset of private Chinese and public English data, enabling multilingual support. Experimental results validate the effectiveness of our approach. Future work will focus on improving real-time performance and refining expression control, further expanding the applications in portrait animation. The code is available at: https://github.com/jdh-algo/JoyVASA.

Feng Li, Kwok-Yan Lam, Min Jia et al.

This paper presents a blockchain-based approach for securing spectrum sharing in multi-beam satellite systems. Satellite spectrum is a scarce resource that requires highly efficient management schemes for optimized sharing by network users. However, spectrum sharing is vulnerable to attacks by malicious protocol participants. In order to ensure efficient spectrum management in the face of dishonest satellite users or cyber attackers, it is important for spectrum sharing mechanism to provide transparency and traceability of the trading process so as to enable the system to detect, and hence eliminate, unauthorized access by malicious users. We address these requirements by proposing the use of blockchain which, apart from its ability to provide transparency and traceability, ensures an immutable means for keeping track of user trading reputation. Besides, in order to address the practical constraints of heterogeneous user nodes, we also propose the use of edge computing to support users with limited computing power. In this paper, we propose a blockchain-based spectrum trading framework and, based on which, a multibeam satellite spectrum sharing algorithm for interference pricing and heterogeneous spectrum demands is devised to improve the efficiency of satellite spectrum. By leveraging on the system characteristics of blockchain, a dynamic spectrum sharing mechanism with traceability, openness and transparency for whole trading process is presented. Numerical results are also provided to evaluate the system benefits and spectrum pricing of the proposed mechanism.