Wei Qi

h-index14
2papers
951citations

2 Papers

1.4PFJun 25
On-Demand Service Zone Design for Energy-Constrained Spatial Queueing Systems

Peng Lin, Cheng Hua, Wei Qi et al.

Electric service vehicles (ESVs), such as mobile chargers and drone-based service units, are becoming an important operational resource for on-demand service systems. Unlike conventional spatial servers, ESV operations are shaped by battery limits and recharging needs, which affect dispatch feasibility and spatial deployment decisions. We develop an energy-constrained hypercube spatial queueing model that embeds battery-state dynamics into the classical hypercube framework and uses a semi-Markov representation to estimate steady-state performance. We then formulate a joint location--zoning problem for station placement and service zone design. The resulting large-scale mixed-integer nonlinear program admits a set partitioning reformulation whose column coefficients are not available in closed form. We therefore develop a Branch-Price-and-Evaluation framework for set partitioning problems with externally computable column coefficients: upper-bounding surrogates guide pricing, and iterative exact evaluation updates the coefficients of active columns. Computational results show that explicit energy modeling significantly reduces false service promises and yields more credible planning decisions. They also reveal a load-dependent reversal in zoning: pooling is preferable under light demand, whereas tighter zoning becomes more profitable as demand increases. Over the tested range, profitability is driven more by zoning than by battery improvement, suggesting that managers should get service zone design right before investing in battery upgrades; this caution is reinforced by the counterintuitive finding that larger batteries may delay replenishment and reduce fleet readiness under sparse demand. These findings show that energy feasibility is not merely a matter of battery-capacity expansion, but a design dimension that shapes service-zone configuration.

7.1LGOct 10, 2025
Robust Driving Control for Autonomous Vehicles: An Intelligent General-sum Constrained Adversarial Reinforcement Learning Approach

Junchao Fan, Qi Wei, Ruichen Zhang et al.

Deep reinforcement learning (DRL) has demonstrated remarkable success in developing autonomous driving policies. However, its vulnerability to adversarial attacks remains a critical barrier to real-world deployment. Although existing robust methods have achieved success, they still suffer from three key issues: (i) these methods are trained against myopic adversarial attacks, limiting their abilities to respond to more strategic threats, (ii) they have trouble causing truly safety-critical events (e.g., collisions), but instead often result in minor consequences, and (iii) these methods can introduce learning instability and policy drift during training due to the lack of robust constraints. To address these issues, we propose Intelligent General-sum Constrained Adversarial Reinforcement Learning (IGCARL), a novel robust autonomous driving approach that consists of a strategic targeted adversary and a robust driving agent. The strategic targeted adversary is designed to leverage the temporal decision-making capabilities of DRL to execute strategically coordinated multi-step attacks. In addition, it explicitly focuses on inducing safety-critical events by adopting a general-sum objective. The robust driving agent learns by interacting with the adversary to develop a robust autonomous driving policy against adversarial attacks. To ensure stable learning in adversarial environments and to mitigate policy drift caused by attacks, the agent is optimized under a constrained formulation. Extensive experiments show that IGCARL improves the success rate by at least 27.9% over state-of-the-art methods, demonstrating superior robustness to adversarial attacks and enhancing the safety and reliability of DRL-based autonomous driving.