R3ST: A Synthetic 3D Dataset With Realistic Trajectories
This addresses the need for realistic synthetic data in traffic analysis and road safety research, offering a dataset that bridges the gap between synthetic and real-world trajectories for trajectory forecasting of road vehicles.
The authors tackled the problem of synthetic datasets lacking realistic vehicle motion by introducing R3ST, a synthetic 3D dataset that integrates real-world trajectories from drone footage, providing accurate multimodal ground-truth annotations and authentic human-driven vehicle trajectories.
Datasets are essential to train and evaluate computer vision models used for traffic analysis and to enhance road safety. Existing real datasets fit real-world scenarios, capturing authentic road object behaviors, however, they typically lack precise ground-truth annotations. In contrast, synthetic datasets play a crucial role, allowing for the annotation of a large number of frames without additional costs or extra time. However, a general drawback of synthetic datasets is the lack of realistic vehicle motion, since trajectories are generated using AI models or rule-based systems. In this work, we introduce R3ST (Realistic 3D Synthetic Trajectories), a synthetic dataset that overcomes this limitation by generating a synthetic 3D environment and integrating real-world trajectories derived from SinD, a bird's-eye-view dataset recorded from drone footage. The proposed dataset closes the gap between synthetic data and realistic trajectories, advancing the research in trajectory forecasting of road vehicles, offering both accurate multimodal ground-truth annotations and authentic human-driven vehicle trajectories.