Zhe Wang

Zhe Wang, Ahcene Ghandriche, Jijun Liu

We consider the wave scattering and inverse scattering in an inhomogeneous medium embedded a homogeneous droplet with a small size, which is modeled by a constant mass density and a small bulk modulus. Based on the Lippmann-Schwinger integral equation for scattering wave in inhomogeneous medium, we firstly develop an efficient approximate scheme for computing the scattered wave as well as its far-field pattern for any droplet located in the inhomogeneous background medium. By establishing the approximate relation between the far-field patterns of the scattered wave before and after the injection of a droplet, the scattered wave of the inhomogeneous medium after injecting the droplet is represented by a measurable far-field patterns, and consequently the inhomogeneity of the medium can be reconstructed from the Helmholtz equation. Finally, the reconstruction process in terms of the dual reciprocity method is proposed to realize the numerical algorithm for recovering the bulk modulus function inside a bounded domain in three dimensional space, by moving the droplet inside the bounded domain. Numerical implementations are given using the simulation data of the far-field pattern to show the validity of the reconstruction scheme, based on the mollification scheme for dealing with the ill-posedness of this inverse problem.

Zhe Bian, Zhe Wang, Wenqiang Han et al.

Since its inception, Vision Transformer (ViT) has emerged as a prevalent model in the computer vision domain. Nonetheless, the multi-head self-attention (MHSA) mechanism in ViT is computationally expensive due to its calculation of relationships among all tokens. Although some techniques mitigate computational overhead by discarding tokens, this also results in the loss of potential information from those tokens. To tackle these issues, we propose a novel token pruning method that retains information from non-crucial tokens by merging them with more crucial tokens, thereby mitigating the impact of pruning on model performance. Crucial and non-crucial tokens are identified by their importance scores and merged based on similarity scores. Furthermore, multi-scale features are exploited to represent images, which are fused prior to token pruning to produce richer feature representations. Importantly, our method can be seamlessly integrated with various ViTs, enhancing their adaptability. Experimental evidence substantiates the efficacy of our approach in reducing the influence of token pruning on model performance. For instance, on the ImageNet dataset, it achieves a remarkable 33% reduction in computational costs while only incurring a 0.1% decrease in accuracy on DeiT-S.

Ting Xiao, Lei Shi, Yang Zhang et al.

Radiology Report Generation (RRG) is an important research topic for relieving radiologist' heavy workload. Existing RRG models mainly rely on supervised fine-tuning (SFT) based on different model architectures using data pairs of radiological images and corresponding radiologist-annotated reports. Recent research has shifted focus to post-training improvements, aligning RRG model outputs with human preferences using reinforcement learning (RL). However, the limited data coverage of high-quality annotated data poses risks of overfitting and generalization. This paper proposes a novel Online Iterative Self-Alignment (OISA) method for RRG that consists of four stages: self-generation of diverse data, self-evaluation for multi-objective preference data,self-alignment for multi-objective optimization and self-iteration for further improvement. Our approach allows for generating varied reports tailored to specific clinical objectives, enhancing the overall performance of the RRG model iteratively. Unlike existing methods, our frame-work significantly increases data quality and optimizes performance through iterative multi-objective optimization. Experimental results demonstrate that our method surpasses previous approaches, achieving state-of-the-art performance across multiple evaluation metrics.