CVApr 1, 2024
MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial MeasurementsLisong C. Sun, Neel P. Bhatt, Jonathan C. Liu et al.
Simultaneous localization and mapping is essential for position tracking and scene understanding. 3D Gaussian-based map representations enable photorealistic reconstruction and real-time rendering of scenes using multiple posed cameras. We show for the first time that using 3D Gaussians for map representation with unposed camera images and inertial measurements can enable accurate SLAM. Our method, MM3DGS, addresses the limitations of prior neural radiance field-based representations by enabling faster rendering, scale awareness, and improved trajectory tracking. Our framework enables keyframe-based mapping and tracking utilizing loss functions that incorporate relative pose transformations from pre-integrated inertial measurements, depth estimates, and measures of photometric rendering quality. We also release a multi-modal dataset, UT-MM, collected from a mobile robot equipped with a camera and an inertial measurement unit. Experimental evaluation on several scenes from the dataset shows that MM3DGS achieves 3x improvement in tracking and 5% improvement in photometric rendering quality compared to the current 3DGS SLAM state-of-the-art, while allowing real-time rendering of a high-resolution dense 3D map. Project Webpage: https://vita-group.github.io/MM3DGS-SLAM
SPJan 27, 2022
Low-Cost Inertial Aiding for Deep-Urban Tightly-Coupled Multi-Antenna Precise GNSSJames E. Yoder, Todd E. Humphreys
A vehicular pose estimation technique is presented that tightly couples multi-antenna carrier-phase differential GNSS (CDGNSS) with a low-cost MEMS inertial sensor and vehicle dynamics constraints. This work is the first to explore the use of consumer-grade inertial sensors for tightly-coupled urban CDGNSS, and first to explore the tightly-coupled combination of multi-antenna CDGNSS and inertial sensing (of any quality) for urban navigation. An unscented linearization permits ambiguity resolution using traditional integer least squares while both implicitly enforcing known-baseline-length constraints and exploiting the multi-baseline problem's inter-baseline correlations. A novel false fix detection and recovery technique is developed to mitigate the effect of conditioning the filter state on incorrect integers. When evaluated on the publicly-available TEX-CUP urban positioning dataset, the proposed technique achieves, with consumer- and industrial-grade inertial sensors, respectively, a 96.6% and 97.5% integer fix availability, and 12.0 cm and 10.1 cm overall (fix and float) 95th percentile horizontal positioning error.
SPSep 9, 2020
All-Weather sub-50-cm Radar-Inertial PositioningLakshay Narula, Peter A. Iannucci, Todd E. Humphreys
Deployment of automated ground vehicles beyond the confines of sunny and dry climes will require sub-lane-level positioning techniques based on radio waves rather than near-visible-light radiation. Like human sight, lidar and cameras perform poorly in low-visibility conditions. This paper develops and demonstrates a novel technique for robust sub-50-cm-accurate urban ground vehicle positioning based on all-weather sensors. The technique incorporates a computationally-efficient globally-optimal radar scan batch registration algorithm into a larger estimation pipeline that fuses data from commercially-available low-cost automotive radars, low-cost inertial sensors, vehicle motion constraints, and, when available, precise GNSS measurements. Performance is evaluated on an extensive and realistic urban data set. Comparison against ground truth shows that during 60 minutes of GNSS-denied driving in the urban center of Austin, TX, the technique maintains 95th-percentile errors below 50 cm in horizontal position and 0.5 degrees in heading.
ROMay 2, 2020
TEX-CUP: The University of Texas Challenge for Urban PositioningLakshay Narula, Daniel M. LaChapelle, Matthew J. Murrian et al.
A public benchmark dataset collected in the dense urban center of the city of Austin, TX is introduced for evaluation of multi-sensor GNSS-based urban positioning. Existing public datasets on localization and/or odometry evaluation are based on sensors such as lidar, cameras, and radar. The role of GNSS in these datasets is typically limited to the generation of a reference trajectory in conjunction with a high-end inertial navigation system (INS). In contrast, the dataset introduced in this paper provides raw ADC output of wideband intermediate frequency (IF) GNSS data along with tightly synchronized raw measurements from inertial measurement units (IMUs) and a stereoscopic camera unit. This dataset will enable optimization of the full GNSS stack from signal tracking to state estimation, as well as sensor fusion with other automotive sensors. The dataset is available at http://radionavlab.ae.utexas.edu under Public Datasets. Efforts to collect and share similar datasets from a number of dense urban centers around the world are under way.
SPMay 2, 2020
Automotive-Radar-Based 50-cm Urban PositioningLakshay Narula, Peter A. Iannucci, Todd E. Humphreys
Deployment of automated ground vehicles (AGVs) beyond the confines of sunny and dry climes will require sub-lane-level positioning techniques based on radio waves rather than near-visible-light radiation. Like human sight, lidar and cameras perform poorly in low-visibility conditions. This paper develops and demonstrates a novel technique for robust 50-cm-accurate urban ground positioning based on commercially-available low-cost automotive radars. The technique is computationally efficient yet obtains a globally-optimal translation and heading solution, avoiding local minima caused by repeating patterns in the urban radar environment. Performance is evaluated on an extensive and realistic urban data set. Comparison against ground truth shows that, when coupled with stable short-term odometry, the technique maintains 95-percentile errors below 50 cm in horizontal position and 1 degree in heading.
SPJun 23, 2019
Deep urban unaided precise Global Navigation Satellite System vehicle positioningTodd E. Humphreys, Matthew J. Murrian, Lakshay Narula
This paper presents the most thorough study to date of vehicular carrier-phase differential GNSS (CDGNSS) positioning performance in a deep urban setting unaided by complementary sensors. Using data captured during approximately 2 hours of driving in and around the dense urban center of Austin, TX, a CDGNSS system is demonstrated to achieve 17-cm-accurate 3D urban positioning (95% probability) with solution availability greater than 87%. The results are achieved without any aiding by inertial, electro-optical, or odometry sensors. Development and evaluation of the unaided GNSS-based precise positioning system is a key milestone toward the overall goal of combining precise GNSS, vision, radar, and inertial sensing for all-weather high-integrity high-absolute-accuracy positioning for automated and connected vehicles. The system described and evaluated herein is composed of a densely-spaced reference network, a software-defined GNSS receiver, and a real-time kinematic (RTK) positioning engine. A performance sensitivity analysis reveals that navigation data wipeoff for fully-modulated GNSS signals and a dense reference network are key to high-performance urban RTK positioning. A comparison with existing unaided systems for urban GNSS processing indicates that the proposed system has significantly greater availability or accuracy.
SPDec 12, 2017
Maximum-Likelihood Power-Distortion Monitoring for GNSS Signal AuthenticationJason N. Gross, Cagri Kilic, Todd E. Humphreys
We propose an extension to the so-called PD detector. The PD detector jointly monitors received power and correlation profile distortion to detect the presence of GNSS carry-off-type spoofing, jamming, or multipath. We show that classification performance can be significantly improved by replacing the PD detector's symmetric-difference-based distortion measurement with one based on the post-fit residuals of the maximum-likelihood estimate of a single-signal correlation function model. We call the improved technique the PD-ML detector. In direct comparison with the PD detector, the PD-ML detector exhibits improved classification accuracy when tested against an extensive library of recorded field data. In particular, it is (1) significantly more accurate at distinguishing a spoofing attack from a jamming attack, (2) better at distinguishing multipath-afflicted data from interference-free data, and (3) less likely to issue a false alarm by classifying multipath as spoofing. The PD-ML detector achieves this improved performance at the expense of additional computational complexity.
CRFeb 21, 2017
GNSS Signal Authentication via Power and Distortion MonitoringKyle D. Wesson, Jason N. Gross, Todd E. Humphreys et al.
We propose a simple low-cost technique that enables civil Global Positioning System (GPS) receivers and other civil global navigation satellite system (GNSS) receivers to reliably detect carry-off spoofing and jamming. The technique, which we call the Power-Distortion detector, classifies received signals as interference-free, multipath-afflicted, spoofed, or jammed according to observations of received power and correlation function distortion. It does not depend on external hardware or a network connection and can be readily implemented on many receivers via a firmware update. Crucially, the detector can with high probability distinguish low-power spoofing from ordinary multipath. In testing against over 25 high-quality empirical data sets yielding over 900,000 separate detection tests, the detector correctly alarms on all malicious spoofing or jamming attacks while maintaining a <0.6% single-channel false alarm rate.