Boyi Yang

Weichen Liu, Qiyao Xue, Haoming Wang et al.

Spatial reasoning, which requires ability to perceive and manipulate spatial relationships in the 3D world, is a fundamental aspect of human intelligence, yet remains a persistent challenge for Multimodal large language models (MLLMs). While existing surveys often categorize recent progress based on input modality (e.g., text, image, video, or 3D), we argue that spatial ability is not solely determined by the input format. Instead, our survey introduces a taxonomy that organizes spatial intelligence from cognitive aspect and divides tasks in terms of reasoning complexity, linking them to several cognitive functions. We map existing benchmarks across text only, vision language, and embodied settings onto this taxonomy, and review evaluation metrics and methodologies for assessing spatial reasoning ability. This cognitive perspective enables more principled cross-task comparisons and reveals critical gaps between current model capabilities and human-like reasoning. In addition, we analyze methods for improving spatial ability, spanning both training-based and reasoning-based approaches. This dual perspective analysis clarifies their respective strengths, uncovers complementary mechanisms. By surveying tasks, benchmarks, and recent advances, we aim to provide new researchers with a comprehensive understanding of the field and actionable directions for future research.

Xiangyu Yin, Boyuan Yang, Weichen Liu et al.

Prosthetic legs play a pivotal role in clinical rehabilitation, allowing individuals with lower-limb amputations the ability to regain mobility and improve their quality of life. Gait analysis is fundamental for optimizing prosthesis design and alignment, directly impacting the mobility and life quality of individuals with lower-limb amputations. Vision-based machine learning (ML) methods offer a scalable and non-invasive solution to gait analysis, but face challenges in correctly detecting and analyzing prosthesis, due to their unique appearances and new movement patterns. In this paper, we aim to bridge this gap by introducing a multi-purpose dataset, namely ProGait, to support multiple vision tasks including Video Object Segmentation, 2D Human Pose Estimation, and Gait Analysis (GA). ProGait provides 412 video clips from four above-knee amputees when testing multiple newly-fitted prosthetic legs through walking trials, and depicts the presence, contours, poses, and gait patterns of human subjects with transfemoral prosthetic legs. Alongside the dataset itself, we also present benchmark tasks and fine-tuned baseline models to illustrate the practical application and performance of the ProGait dataset. We compared our baseline models against pre-trained vision models, demonstrating improved generalizability when applying the ProGait dataset for prosthesis-specific tasks. Our code is available at https://github.com/pittisl/ProGait and dataset at https://huggingface.co/datasets/ericyxy98/ProGait.

Boyi Yang, Marina Piccinelli, Gaetano Esposito et al.

As experts continue to debate the optimal surgery practice for coronary disease - percutaneous coronary intervention (PCI) or coronary aortic bypass graft (CABG) - computational tools may provide a quantitative assessment of each option. Computational fluid dynamics (CFD) has been used to assess the interplay between hemodynamics and stent struts; it is of particular interest in Bioresorbable Vascular Stents (BVS), since their thicker struts may result in impacted flow patterns and possible pathological consequences. Many proofs of concept are presented in the literature; however, a practical method for extracting patient-specific stented coronary artery geometries from images over a large number of patients remains an open problem. This work provides a possible pipeline for the reconstruction of the BVS. Using Optical Coherence Tomographies (OCT) and Invasive Coronary Angiographies (ICA), we can reconstruct the 3D geometry of deployed BVS in vivo. We illustrate the stent reconstruction process: (i) automatic strut detection, (ii) identification of stent components, (iii) 3D registration of stent curvature, and (iv) final stent volume reconstruction. The methodology is designed for use on clinical OCT images, as opposed to approaches that relied on a small number of virtually deployed stents. The proposed reconstruction process is validated with a virtual phantom stent, providing quantitative assessment of the methodology, and with selected clinical cases, confirming feasibility. Using multimodality image analysis, we obtain reliable reconstructions within a reasonable timeframe. This work is the first step toward a fully automated reconstruction and simulation procedure aiming at an extensive quantitative analysis of the impact of BVS struts on hemodynamics via CFD in clinical trials, going beyond the proof-of-concept stage.