J Ramón Arrowsmith

Zhiang Chen, J Ramon Arrowsmith, Jnaneshwar Das

Robotic mapping is useful in scientific applications that involve surveying unstructured environments. This paper presents a target-oriented mapping system for sparsely distributed geologic surface features, such as precariously balanced rocks (PBRs), whose geometric fragility parameters can provide valuable information on earthquake shaking history and landscape development for a region. With this geomorphology problem as the test domain, we demonstrate a pipeline for detecting, localizing, and precisely mapping fragile geologic features distributed on a landscape. To do so, we first carry out a lawn-mower search pattern in the survey region from a high elevation using an Unpiloted Aerial Vehicle (UAV). Once a potential PBR target is detected by a deep neural network, we track the bounding box in the image frames using a real-time tracking algorithm. The location and occupancy of the target in world coordinates are estimated using a sampling-based filtering algorithm, where a set of 3D points are re-sampled after weighting by the tracked bounding boxes from different camera perspectives. The converged 3D points provide a prior on 3D bounding shape of a target, which is used for UAV path planning to closely and completely map the target with Simultaneous Localization and Mapping (SLAM). After target mapping, the UAV resumes the lawn-mower search pattern to find the next target. We introduce techniques to make the target mapping robust to false positive and missing detection from the neural network. Our target-oriented mapping system has the advantages of reducing map storage and emphasizing complete visible surface features on specified targets.

Zhiang Chen, Sarah Bearman, J Ramon Arrowsmith et al.

Robotic mapping is attractive in many scientific applications that involve environmental surveys. This paper presents a system for localization and mapping of sparsely distributed surface features such as precariously balanced rocks (PBRs), whose geometric fragility parameters provide valuable information on earthquake processes and landscape development. With this geomorphologic problem as the test domain, we carry out a lawn-mower search pattern from a high elevation using an Unpiloted Aerial Vehicle (UAV) equipped with a flight controller, GPS module, stereo camera, and onboard computer. Once a potential PBR target is detected by a deep neural network in real time, we track its bounding box in the image coordinates by applying a Kalman filter that fuses the deep learning detection with Kanade-Lucas-Tomasi (KLT) tracking. The target is localized in world coordinates using depth filtering where a set of 3D points are filtered by object bounding boxes from different camera perspectives. The 3D points also provide a strong prior on target shape, which is used for UAV path planning to closely map the target using RGBD SLAM. After target mapping, the UAS resumes the lawn-mower search pattern to locate and map the next target.