Relax Within, Balance Across: Geometry-Guided Load Balancing for Vision-Language Mixture-of-ExpertsZiang Wu, Peng Jin, Qishen Yin et al.
Vision-language MoE batches contain different numbers of image and text tokens. Image resolution, image count, tiling, and prompt length all change this token mix. We call the standard token-level Switch auxiliary loss Std-Aux. Std-Aux balances only the mixed load, so large image and text load errors can cancel at one mix. On our main model, the same trained router shows more than a fivefold change in load imbalance across image resolutions. We hold the image and text load profiles fixed and derive the exact load curve as the token mix varies. The image-text load gap controls sensitivity to the token mix. Physical preprocessing can also change the conditional profiles. The fixed-profile law excludes such changes. To design a remedy, we examine the router input structure. Image and text occupy distinct regions, while visual tokens group strongly by source image. The modality boundary motivates separate image and text terms. The image boundary motivates one equal-weight routing instance per image. ReBA, or Relax Within, Balance Across, implements both choices. Across four split backbones, ReBA lowers load on every reported benchmark input while keeping mean task accuracy comparable to Std-Aux. ReBA also lowers average load over the tested range and worst physical load under resolution and tiling shifts. Code is available at https://github.com/ZiangWu-77/ReBA.
9.6SDAug 2
JoyAI-Talker: Full-Duplex Speech Interactive Large Model Built for Empathetic Voice AgentsYinhao Bai, Jinming Chen, Yafeng Chen et al.
We present JoyAI-Talker, a full-duplex speech dialogue system that delivers robust foundation model capabilities while empowering empathetic interaction and voice agent intelligence. JoyAI-Talker adopts a modular Thinker-Talker architecture and further implements a unified speech-text joint training pipeline to mitigate the common "cognitive degradation" bottleneck, thereby largely preserving the model's core textual reasoning, STEM, and logical capabilities while extending them to speech-based interaction. For expressive speech synthesis, the Talker module employs a text-controllable generation paradigm that enables natural-language instructions to flexibly control vocal attributes and localized paralinguistic events, such as laughter and sighs, supporting more expressive and fine-grained speech responses. To enhance conversational empathy, we introduce the Persona-Adaptive Empathetic Response (PAER) framework. PAER employs a hierarchical cognitive pipeline to extract non-verbal speaker cues, such as gender, age, and emotional state, from raw input audio, incorporate them into the Thinker's CoT reasoning, and generate context-adaptive responses that align semantically appropriate text with fine-grained control over utterance-level expressiveness and localized paralinguistic events, including sighs, speaking rate, and volume. We further integrate Joy-Duplex, a state-driven, plug-and-play full-duplex framework that functions as an efficient gating engine for real-time turn control. Extensive evaluations show that JoyAI-Talker achieves highly competitive performance on foundational T2T and S2T benchmarks. In full-duplex evaluation, the system reaches a high response rate of 0.88 under user interruptions while maintaining an extremely low false-trigger rate under background speech, demonstrating its readiness for fluid and natural speech dialogue.
20.5AIAug 3
SKT: Skill-Use Training at Scale via Verified Synthetic Data GenerationZelin Tan, Yiqun Zhang, Hao Li et al.
Agent skills have become an important mechanism for equipping language-model agents with reusable procedural knowledge. However, providing skills alone does not guarantee that current models can effectively identify, apply, and coordinate them. To improve skill-use capabilities, we introduce SKT, a verified data synthesis pipeline that constructs skill-grounded tasks and executable trajectories from large collections of agent skills. SKT selects suitable single-skill and multi-skill configurations, synthesizes tasks through rule-based and agent-based verification with feedback-guided repair, and retains only successful trajectories that substantially use every required skill. Using 2,000 public skills, SKT produces 4,000 task packages and 27,164 verified trajectories. Based on the same pipeline and a disjoint test pool, we further construct SkillEval, a held-out executable benchmark for evaluating skill use. Experiments across diverse models, benchmarks, and agent harnesses show that supervised fine-tuning on SKT-generated trajectories consistently improves skill-use performance. Verification ablations, cross-harness evaluation, and scaling experiments further demonstrate that these gains depend on high-quality supervision, extend beyond a single agent interface, and increase with broader skill coverage. Together, these results establish verified data synthesis as an effective and scalable approach for skill-use training.
5.5CVAug 2
From Forest to Future Capital: Tracking Land Cover Change in Ibu Kota Nusantara (IKN) from 2021 to 2026 with PlanetScope ImageryClarissa Rui Min Ong, Elizabeth Tee Inn Loo, Kenneth Woon Hao Soh et al.
Indonesia's relocation of its political and administrative capital from Jakarta to Ibu Kota Nusantara (IKN) has been framed around a ``Forest City'' vision, yet rapid construction within the Core Government Area (KIPP) raises concerns over land conversion, vegetation loss, and carbon stock decline. This study applies remote sensing techniques to systematically assess land use and vegetation cover change in KIPP from 2021 to 2026 using PlanetScope SuperDove satellite imagery. Cloud-free mosaics were prepared and analysed through spectral indices, including the Normalised Difference Vegetation Index (NDVI), Normalised Difference Red Edge (NDRE), and Normalised Difference Water Index (NDWI), alongside supervised land use and land cover (LULC) classification using a Support Vector Machine algorithm. Results show substantial environmental transformation, with mean NDVI declined by 17.1\%, total carbon stock decreased by 0.28\%, developed land expanded by 672\%, and total vegetation declined by 18.1\%. Vegetation loss was most extensive between 2023 and 2024, although a temporary recovery in NDVI and carbon stock occurred from 2024 to 2025 as active clearing slowed and development shifted towards already-cleared land. Overall, the findings demonstrate that remote sensing provides an effective approach for monitoring the environmental impacts of large-scale urban development, while highlighting the need for higher-resolution, hyperspectral, and SAR-based methods to improve detection of construction stages and plantation-related land cover changes.