Long Wang

Jiahu Qin, Qichao Ma, Xinghuo Yu et al.

In this paper, we aim to investigate the synchronization problem of dynamical systems, which can be of generic linear or Lipschitz nonlinear type, communicating over directed switching network topologies. A mild connectivity assumption on the switching topologies is imposed, which allows them to be directed and jointly connected. We propose a novel analysis framework from both algebraic and geometric perspectives to justify the attractiveness of the synchronization manifold. Specifically, it is proven that the complementary space of the synchronization manifold can be spanned by certain subspaces. These subspaces can be the eigenspaces of the nonzero eigenvalues of Laplacian matrices in linear case. They can also be subspaces in which the projection of the nonlinear self-dynamics still retains the Lipschitz property. This allows to project the states of the dynamical systems into these subspaces and transform the synchronization problem under consideration equivalently into a convergence one of the projected states in each subspace. Then, assuming the joint connectivity condition on the communication topologies, we are able to work out a simple yet effective and unified convergence analysis for both types of dynamical systems. More specifically, for partial-state coupled generic linear systems, it is proven that synchronization can be reached if an extra condition, which is easy to verify in several cases, on the system dynamics is satisfied. For Lipschitz-type nonlinear systems with positive-definite inner coupling matrix, synchronization is realized if the coupling strength is strong enough to stabilize the evolution of the projected states in each subspace under certain conditions.

Yuanshi Zheng, Jingying Ma, Long Wang

In this paper, we consider the consensus problem of hybrid multi-agent system. First, the hybrid multi-agent system is proposed which is composed of continuous-time and discrete-time dynamic agents. Then, three kinds of consensus protocols are presented for hybrid multi-agent system. The analysis tool developed in this paper is based on the matrix theory and graph theory. With different restrictions of the sampling period, some necessary and sufficient conditions are established for solving the consensus of hybrid multi-agent system. The consensus states are also obtained under different protocols. Finally, simulation examples are provided to demonstrate the effectiveness of our theoretical results.

Yuanshi Zheng, Jingying Ma, Long Wang

In this paper, we consider the consensus problem of switched multi-agent system composed of continuous-time and discrete-time subsystems. By combining the classical consensus protocols of continuous-time and discrete-time multi-agent systems, we propose a linear consensus protocol for switched multi-agent system. Based on the graph theory and Lyapunov theory, we prove that the consensus of switched multi-agent system is solvable under arbitrary switching with undirected connected graph, directed graph and switching topologies, respectively. Simulation examples are also provided to demonstrate the effectiveness of the theoretical results.

Shen Yan, Yu Liu, Long Wang et al.

Despite the remarkable advances in image matching and pose estimation, image-based localization of a camera in a temporally-varying outdoor environment is still a challenging problem due to huge appearance disparity between query and reference images caused by illumination, seasonal and structural changes. In this work, we propose to leverage additional sensors on a mobile phone, mainly GPS, compass, and gravity sensor, to solve this challenging problem. We show that these mobile sensors provide decent initial poses and effective constraints to reduce the searching space in image matching and final pose estimation. With the initial pose, we are also able to devise a direct 2D-3D matching network to efficiently establish 2D-3D correspondences instead of tedious 2D-2D matching in existing systems. As no public dataset exists for the studied problem, we collect a new dataset that provides a variety of mobile sensor data and significant scene appearance variations, and develop a system to acquire ground-truth poses for query images. We benchmark our method as well as several state-of-the-art baselines and demonstrate the effectiveness of the proposed approach. The code and dataset will be released publicly.

Kaihong Lu, Gangshan Jing, Long Wang

In this paper, a class of convex feasibility problems (CFPs) are studied for multi-agent systems through local interactions. The objective is to search a feasible solution to the convex inequalities with some set constraints in a distributed manner. The distributed control algorithms, involving subgradient and projection, are proposed for both continuous- and discrete-time systems, respectively. Conditions associated with connectivity of the directed communication graph are given to ensure convergence of the algorithms. It is shown that under mild conditions, the states of all agents reach consensus asymptotically and the consensus state is located in the solution set of the CFP. Simulation examples are presented to demonstrate the effectiveness of the theoretical results.

Gangshan Jing, Guofeng Zhang, Heung Wing Joseph Lee et al.

This paper presents an angle-based approach for distributed formation shape stabilization of multi-agent systems in the plane. We develop an angle rigidity theory to study whether a planar framework can be determined by angles between segments uniquely up to translations, rotations, scalings and reflections. The proposed angle rigidity theory is applied to the formation stabilization problem, where multiple single-integrator modeled agents cooperatively achieve an angle-constrained formation. During the formation process, the global coordinate system is unknown for each agent and wireless communications between agents are not required. Moreover, by utilizing the advantage of high degrees of freedom, we propose a distributed control law for agents to stabilize a target formation shape with desired orientation and scale. Simulation examples are performed for illustrating effectiveness of the proposed control strategies.

Xue Lin, Yuanshi Zheng, Long Wang

In this paper, a discrete-time multi-agent system is presented which is formulated in terms of the delta operator. The proposed multi-agent system can unify discrete-time and continuous-time multi-agent systems. In a multi-agent network, in practice, the communication among agents is acted upon by various factors. The communication network among faulty agents may cause link failures, which is modeled by randomly switching graphs. First, we show that the delta representation of discrete-time multi-agent system reaches consensus in mean (in probability and almost surely) if the expected graph is strongly connected. The results induce that the continuous-time multi-agent system with random networks can also reach consensus in the same sense. Second, the influence of faulty agents on consensus value is quantified under original network. By using matrix perturbation theory, the error bound is also presented in this paper. Finally, a simulation example is provided to demonstrate the effectiveness of our theoretical results.

Gangshan Jing, Guofeng Zhang, Heung Wing Joseph Lee et al.

This paper introduces the notion of weak rigidity to characterize a framework by pairwise inner products of inter-agent displacements. Compared to distance-based rigidity, weak rigidity requires fewer constrained edges in the graph to determine a geometric shape in an arbitrarily dimensional space. A necessary and sufficient graphical condition for infinitesimal weak rigidity of planar frameworks is derived. As an application of the proposed weak rigidity theory, a gradient based control law and a non-gradient based control law are designed for a group of single-integrator modeled agents to stabilize a desired formation shape, respectively. Using the gradient control law, we prove that an infinitesimally weakly rigid formation is locally exponentially stable. In particular, if the number of agents is one greater than the dimension of the space, a minimally infinitesimally weakly rigid formation is almost globally asymptotically stable. In the literature of rigid formation, the sensing graph is always required to be rigid. Using the non-gradient control law based on weak rigidity theory, the sensing graph is unnecessary to be rigid for local exponential stability of the formation. A numerical simulation is performed for illustrating effectiveness of our main results.

Long Wang, Feng Fu, Xingru Chen

Evolutionary Game Theory (EGT) and Artificial Intelligence (AI) are two fields that, at first glance, might seem distinct, but they have notable connections and intersections. The former focuses on the evolution of behaviors (or strategies) in a population, where individuals interact with others and update their strategies based on imitation (or social learning). The more successful a strategy is, the more prevalent it becomes over time. The latter, meanwhile, is centered on machine learning algorithms and (deep) neural networks. It is often from a single-agent perspective but increasingly involves multi-agent environments, in which intelligent agents adjust their strategies based on feedback and experience, somewhat akin to the evolutionary process yet distinct in their self-learning capacities. In light of the key components necessary to address real-world problems, including (i) learning and adaptation, (ii) cooperation and competition, (iii) robustness and stability, and altogether (iv) population dynamics of individual agents whose strategies evolve, the cross-fertilization of ideas between both fields will contribute to the advancement of mathematics of multi-agent learning systems, in particular, to the nascent domain of ``collective cooperative intelligence'' bridging evolutionary dynamics and multi-agent reinforcement learning.

Zhitao Wang, Wei Wang, Zirao Li et al.

In past years, we have been dedicated to automating user acceptance testing (UAT) process of WeChat Pay, one of the most influential mobile payment applications in China. A system titled XUAT has been developed for this purpose. However, there is still a human-labor-intensive stage, i.e, test scripts generation, in the current system. Therefore, in this paper, we concentrate on methods of boosting the automation level of the current system, particularly the stage of test scripts generation. With recent notable successes, large language models (LLMs) demonstrate significant potential in attaining human-like intelligence and there has been a growing research area that employs LLMs as autonomous agents to obtain human-like decision-making capabilities. Inspired by these works, we propose an LLM-powered multi-agent collaborative system, named XUAT-Copilot, for automated UAT. The proposed system mainly consists of three LLM-based agents responsible for action planning, state checking and parameter selecting, respectively, and two additional modules for state sensing and case rewriting. The agents interact with testing device, make human-like decision and generate action command in a collaborative way. The proposed multi-agent system achieves a close effectiveness to human testers in our experimental studies and gains a significant improvement of Pass@1 accuracy compared with single-agent architecture. More importantly, the proposed system has launched in the formal testing environment of WeChat Pay mobile app, which saves a considerable amount of manpower in the daily development work.

Xiaojun Jia, Yihao Huang, Yang Liu et al.

This paper introduces the Global Challenge for Safe and Secure Large Language Models (LLMs), a pioneering initiative organized by AI Singapore (AISG) and the CyberSG R&D Programme Office (CRPO) to foster the development of advanced defense mechanisms against automated jailbreaking attacks. With the increasing integration of LLMs in critical sectors such as healthcare, finance, and public administration, ensuring these models are resilient to adversarial attacks is vital for preventing misuse and upholding ethical standards. This competition focused on two distinct tracks designed to evaluate and enhance the robustness of LLM security frameworks. Track 1 tasked participants with developing automated methods to probe LLM vulnerabilities by eliciting undesirable responses, effectively testing the limits of existing safety protocols within LLMs. Participants were challenged to devise techniques that could bypass content safeguards across a diverse array of scenarios, from offensive language to misinformation and illegal activities. Through this process, Track 1 aimed to deepen the understanding of LLM vulnerabilities and provide insights for creating more resilient models.

Feng Huang, Ming Cao, Long Wang

In stochastic dynamic environments, team Markov games have emerged as a versatile paradigm for studying sequential decision-making problems of fully cooperative multi-agent systems. However, the optimality of the derived policies is usually sensitive to model parameters, which are typically unknown and required to be estimated from noisy data in practice. To mitigate the sensitivity of optimal policies to these uncertain parameters, we propose a robust model of team Markov games in this paper, where agents utilize robust optimization approaches to update strategies. This model extends team Markov games to the scenario of incomplete information and meanwhile provides an alternative solution concept of robust team optimality. To seek such a solution, we develop a robust iterative learning algorithm of team policies and prove its convergence. This algorithm, compared with robust dynamic programming, not only possesses a faster convergence rate, but also allows for using approximation calculations to alleviate the curse of dimensionality. Moreover, some numerical simulations are presented to demonstrate the effectiveness of the algorithm by generalizing the game model of sequential social dilemmas to uncertain scenarios.

Kaihua Zhang, Long Wang, Dong Liu et al.

Video Object Segmentation (VOS) is typically formulated in a semi-supervised setting. Given the ground-truth segmentation mask on the first frame, the task of VOS is to track and segment the single or multiple objects of interests in the rest frames of the video at the pixel level. One of the fundamental challenges in VOS is how to make the most use of the temporal information to boost the performance. We present an end-to-end network which stores short- and long-term video sequence information preceding the current frame as the temporal memories to address the temporal modeling in VOS. Our network consists of two temporal sub-networks including a short-term memory sub-network and a long-term memory sub-network. The short-term memory sub-network models the fine-grained spatial-temporal interactions between local regions across neighboring frames in video via a graph-based learning framework, which can well preserve the visual consistency of local regions over time. The long-term memory sub-network models the long-range evolution of object via a Simplified-Gated Recurrent Unit (S-GRU), making the segmentation be robust against occlusions and drift errors. In our experiments, we show that our proposed method achieves a favorable and competitive performance on three frequently-used VOS datasets, including DAVIS 2016, DAVIS 2017 and Youtube-VOS in terms of both speed and accuracy.

Ye Tian, Long Wang

Classic models on opinion dynamics usually focus on a group of agents forming their opinions interactively over single issue. Yet generally consensus can not be achieved over single issue when agents are not completely open to interpersonal influence. In this paper, opinion consensus in social networks with stubborn agents is considered over issue sequences. The social network with stubborn agents is described by the Friedkin-Johnsen (F-J) model where agents are stubborn to their initial opinions. Firstly, we propose some sufficient and necessary conditions both in terms of network topology and system matrix for convergence of the F-J model over single issue. Secondly, opinion consensus of the F-J model is investigated over issue sequences. Our analysis establishes connections between the interpersonal influence network and the network describing the relationship of agents' initial opinions for successive issues. Taking advantage of these connections, we derive the sufficient and necessary condition for the F-J model to achieve opinion consensus over issue sequences. Finally, we consider a more general scenario where each agent has bounded confidence in forming its initial opinion for every issue. By analyzing the evolution of agents' ultimate opinions for each issue over issue sequences, we prove that the connectivity of the state-dependent network is preserved in this setting. Then the conditions for agents to achieve opinion consensus over issue sequences are proposed. Simulation examples are provided to illustrate the effectiveness of our theoretical results.

Kaihong Lu, Gangshan Jing, Long Wang

In this paper, a distributed subgradient-based algorithm is proposed for continuous-time multi-agent systems to search a feasible solution to convex inequalities. The algorithm involves each agent achieving a state constrained by its own inequalities while exchanging local information with other agents under a time-varying directed communication graph. With the validity of a mild connectivity condition associated with the communication graph, it is shown that all agents will reach agreement asymptotically and the consensus state is in the solution set of the inequalities. Furthermore, the method is also extended to solving the distributed optimization problem of minimizing the sum of local objective functions subject to convex inequalities. A simulation example is presented to demonstrate the effectiveness of the theoretical results.

Bin Zhao, Yongqiang Guan, Long Wang

Controllability of multi-agent systems is determined by the interconnection topologies. In practice, losing agents can change the topologies of multi-agent systems, which may affect the controllability. This paper studies non-fragility of controllability influenced by losing agents. In virtue of the concept of cutsets, necessary and sufficient conditions are established from a graphic perspective, for strong non-fragility and weak non-fragility of controllability, respectively. For multi-agent systems which contain important agents, partial controllability is proposed in terms of the concept of controllable node groups, and necessary and sufficient criteria are established for partial controllability. Moreover, partial controllability preserving problem is proposed. Utilizing the concept of compressed graphs, this problem is transformed into finding the the minimal $\mathbf{\langle s,t\rangle}$ vertex cutsets of the interconnection graph, which has a polynomial-time complexity algorithm for the solution. Several constructive examples illuminate the theoretical results.

Bin Zhao, Yongqiang Guan, Long Wang

For an uncontrollable system, adding leaders and adjusting edge weights are two methods to improve controllability. In this paper, controllability of multi-agent systems under directed topologies is studied, especially on leader selection problem and weight adjustment problem. For a given system, necessary and sufficient algebraic conditions for controllability with fewest leaders are proposed. From another perspective, when leaders are fixed, controllability could be improved by adjusting edge weights, and therefore the system is supposed to be structurally controllable, which holds if and only if the communication topology contains a spanning tree. It is also proved that the number of fewest edges needed to be assigned on new weights equals the rank deficiency of controllability matrix. An algorithm on how to perform weight adjustment is presented. Simulation examples are provided to illustrate the theoretical results.

Gangshan Jing, Yuanshi Zheng, Long Wang

In this paper, we study the consensus problem for continuous-time and discrete-time multi-agent systems in state-dependent switching networks. In each case, we first consider the networks with fixed connectivity, in which the communication between adjacent agents always exists but the influence could possibly become negligible if the transmission distance is long enough. It is obtained that consensus can be reached under a restriction of either the decaying rate of the transmission weight or the initial states of the agents. After then we investigate the networks with state-dependent connectivity, in which the information transmission between adjacent agents gradually vanishes if their distance exceeds a fixed range. In such networks, we prove that the realization of consensus requires the validity of some initial conditions. Finally, the conclusions are applied to models with the transmission law of C-S model, opinion dynamics and the rendezvous problem, the corresponding simulations are also presented.

Jingying Ma, Yuanshi Zheng, Bin Wu et al.

It is typical to assume that there is no conflict of interest among leaders. Under such assumption, it is known that, for a multi-agent system with two leaders, if the followers' interaction subgraph is undirected and connected, then followers will converge to a convex combination of two leaders' states with linear consensus protocol. In this paper, we introduce the conflict between leaders: by choosing k followers to connect with, every leader attempts all followers converge to himself closer than that of the other. By using graph theory and matrix theory, we formulate this conflict as a standard two-player zero-sum game and give some properties about it. It is noteworthy that the interaction graph here is generated from the conflict between leaders. Interestingly, we find that to find the optimal topology of the system is equivalent to solve a Nash equilibrium. Especially for the case of choosing one connected follower, the necessary and sufficient condition for an interaction graph to be the optimal one is given. Moreover, if followers' interaction graph is a circulant graph or a graph with a center node, then the system's optimal topology is obtained. Simulation examples are provided to validate the effectiveness of the theoretical results.