Shufang Lu

Jiazhou Chen, Yanghui Xu, Shufang Lu et al.

We present a novel 3D instance segmentation framework for Multi-View Stereo (MVS) buildings in urban scenes. Unlike existing works focusing on semantic segmentation of urban scenes, the emphasis of this work lies in detecting and segmenting 3D building instances even if they are attached and embedded in a large and imprecise 3D surface model. Multi-view RGB images are first enhanced to RGBH images by adding a heightmap and are segmented to obtain all roof instances using a fine-tuned 2D instance segmentation neural network. Instance masks from different multi-view images are then clustered into global masks. Our mask clustering accounts for spatial occlusion and overlapping, which can eliminate segmentation ambiguities among multi-view images. Based on these global masks, 3D roof instances are segmented out by mask back-projections and extended to the entire building instances through a Markov random field optimization. A new dataset that contains instance-level annotation for both 3D urban scenes (roofs and buildings) and drone images (roofs) is provided. To the best of our knowledge, it is the first outdoor dataset dedicated to 3D instance segmentation with much more annotations of attached 3D buildings than existing datasets. Quantitative evaluations and ablation studies have shown the effectiveness of all major steps and the advantages of our multi-view framework over the orthophoto-based method.

Ailing Cheng, Jiaojiao Ye, Fei Yang et al.

Aiming at the accurate and effective coaxiality measurement for twist drill with irregular surface, an optical measurement mechanism is proposed in this paper. First, A high-precision rotation instrument based on four core units is designed, which can obtain the 3-D point cloud data of full angle for the twist drill. Second, in the data processing stage, an improved robust Gaussian mixture model is established for accurate and rapid blade back segmentation. To improve measurement efficiency, a rapid reconstruction method of the twist drill axis based on orthogonal synthesis is provided to locate the axial position of the maximum deviation from the benchmark by utilizing the extracted blade back data. Finally, by calculating the maximum radial Euclidean distance from the benchmark, the coaxiality error of the twist drill is obtained. Comparing with other measurement methods, experimental results show that our proposed method is effective with high precision of 3 um and high efficiency of less than 3 s/pc. The result demonstrate that the proposed method is effective, robust and automatic, it can be applied in many actual industrial scene.