Bin Wang

Bin Wang, Kai Sun, Xin Xu

Nonlinear modal decoupling (NMD) was recently proposed to nonlinearly transform a multi-oscillator system into a number of decoupled oscillators which together behave the same as the original system in an extended neighborhood of the equilibrium. Each oscillator has just one degree of freedom and hence can easily be analyzed to infer the stability of the original system associated with one electromechanical mode. As the first attempt of applying the NMD methodology to realistic power system models, this paper proposes an NMD-based transient stability analysis approach. For a multi-machine power system, the approach first derives decoupled nonlinear oscillators by a coordinates transformation, and then applies Lyapunov stability analysis to oscillators to assess the stability of the original system. Nonlinear modal interaction is also considered. The approach can be efficiently applied to a large-scale power grid by conducting NMD regarding only selected modes. Case studies on a 3-machine 9-bus system and an NPCC 48-machine 140-bus system show the potentials of the approach in transient stability analysis for multi-machine systems.

Zhiyong Yan, Heinrich Dinkel, Yongqing Wang et al.

Audio-text retrieval is a challenging task, requiring the search for an audio clip or a text caption within a database. The predominant focus of existing research on English descriptions poses a limitation on the applicability of such models, given the abundance of non-English content in real-world data. To address these linguistic disparities, we propose a language enhancement (LE), using a multilingual text encoder (SONAR) to encode the text data with language-specific information. Additionally, we optimize the audio encoder through the application of consistent ensemble distillation (CED), enhancing support for variable-length audio-text retrieval. Our methodology excels in English audio-text retrieval, demonstrating state-of-the-art (SOTA) performance on commonly used datasets such as AudioCaps and Clotho. Simultaneously, the approach exhibits proficiency in retrieving content in seven other languages with only 10% of additional language-enhanced training data, yielding promising results. The source code is publicly available https://github.com/zyyan4/ml-clap.

Yiming Gao, Bin Wang, Chengwei Wei et al.

Large language models (LLMs) have demonstrated strong instruction-following capabilities in text-based tasks. However, this ability often deteriorates in multimodal models after alignment with non-text modalities such as images or audio. While several recent efforts have investigated instruction-following performance in text and vision-language models, instruction-following in audio-based large language models remains largely unexplored. To bridge this gap, we introduce IFEval-Audio, a novel evaluation dataset designed to assess the ability to follow instructions in an audio LLM. IFEval-Audio contains 280 audio-instruction-answer triples across six diverse dimensions: Content, Capitalization, Symbol, List Structure, Length, and Format. Each example pairs an audio input with a text instruction, requiring the model to generate an output that follows a specified structure. We benchmark state-of-the-art audio LLMs on their ability to follow audio-involved instructions. The dataset is released publicly to support future research in this emerging area.