From Gaming to Research: GTA V for Synthetic Data Generation for Robotics and Navigations
This provides a cost-effective and scalable solution for researchers in robotics and computer vision, though it is incremental as it applies an existing method (synthetic data generation) to a new domain using a video game.
The study tackled the challenge of acquiring diverse real-world datasets for robotics and navigation by using Grand Theft Auto V to generate synthetic data, demonstrating that it is qualitatively comparable to real-world data and can complement or substitute it in SLAM and VPR applications.
In computer vision, the development of robust algorithms capable of generalizing effectively in real-world scenarios more and more often requires large-scale datasets collected under diverse environmental conditions. However, acquiring such datasets is time-consuming, costly, and sometimes unfeasible. To address these limitations, the use of synthetic data has gained attention as a viable alternative, allowing researchers to generate vast amounts of data while simulating various environmental contexts in a controlled setting. In this study, we investigate the use of synthetic data in robotics and navigation, specifically focusing on Simultaneous Localization and Mapping (SLAM) and Visual Place Recognition (VPR). In particular, we introduce a synthetic dataset created using the virtual environment of the video game Grand Theft Auto V (GTA V), along with an algorithm designed to generate a VPR dataset, without human supervision. Through a series of experiments centered on SLAM and VPR, we demonstrate that synthetic data derived from GTA V are qualitatively comparable to real-world data. Furthermore, these synthetic data can complement or even substitute real-world data in these applications. This study sets the stage for the creation of large-scale synthetic datasets, offering a cost-effective and scalable solution for future research and development.