Guangming Yao

h-index15
3papers
665citations

3 Papers

2.5OCFeb 16
A Homotopy Framework for Constrained Multiobjective Optimization

Olaoluwa Ogunleye, Guangming Yao, Jianhua Zhang

We develop a homotopy-based framework for computing Karush-Kuhn-Tucker (KKT) points of multiobjective optimization problems. The proposed homotopy map continuously deforms an easily solvable system into the KKT conditions associated with the multiobjective problem, yielding a deterministic and structure-preserving continuation path. Under mild regularity assumptions, we establish global convergence of the homotopy trajectory to a Pareto-stationary solution for any initial point chosen in the interior of the feasible region. In numerical experiments, the method exhibits robust convergence even when initialized from nonfeasible points, indicating stability beyond the theoretical guarantees. Efficient predictor-corrector continuation strategies are employed to trace the homotopy path. Numerical results on benchmark problems compare the proposed approach with classical scalarization methods and the evolutionary algorithm NSGA-II, demonstrating competitive computational efficiency and consistent solution quality. These results highlight the effectiveness of the homotopy framework for constrained multiobjective optimization and motivate extensions to more general problem settings and adaptive parameter strategies.

13.4CVJun 5
MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism

Cong Chen, Guo Gan, Kaixiang Ji et al.

Current Vision-Language Models struggle with hours-long videos because processing full-length visual sequences induces prohibitive token explosion and attention dilution. To overcome this, we introduce MemDreamer to decouple perception and reasoning, shifting long-video understanding into an agentic exploration process. As a plug-and-play framework, it incrementally streams videos to construct a Hierarchical Graph Memory, a top-down three-tier architecture for semantic abstraction, anchored by a foundational graph capturing spatiotemporal and causal relations. During inference, the reasoning model employs agentic tool-augmented retrieval, navigating hierarchies, searching nodes, and traversing logical edges via an Observation-Reason-Action loop. Experiments show MemDreamer achieves SOTA results across four mainstream benchmarks, narrowing the gap with human experts to only 3.7 points. It constrains the reasoning context window to merely 2% of full-context ingestion while delivering a 12.5 point absolute accuracy gain. Furthermore, statistical analysis uncovers a strong positive linear correlation between an VLM's performance on logic reasoning and long-video understanding benchmarks, establishing agentic capability scaling as a new paradigm for multimodal comprehension.

6.5CVDec 23, 2021
Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields

Guangming Yao, Hongzhi Wu, Yi Yuan et al.

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double diffusion mechanism to achieve expressive representations of input images by fully exploiting human body priors and image appearance details at two levels. At the coarse level, we first model the coarse human body poses and shapes via an unclothed 3D deformable vertex model as guidance. At the fine level, we present a multi-view sampling network to capture subtle geometric deformations and image detailed appearances, such as clothing and hair, from multiple input views. Considering the sparsity of the two level features, we diffuse them into feature volumes in the canonical space to construct neural radiance fields. Then, we present a signed distance function (SDF) regression network to construct body surfaces from the diffused features. Thanks to our double diffused representations, our method can even synthesize novel views of unseen subjects. Experiments on various datasets demonstrate that our approach outperforms the state-of-the-art in both geometric reconstruction and novel view synthesis.