A metric for sets of trajectories that is practical and mathematically consistent
This addresses a fundamental issue for researchers in computer vision, machine learning, robotics, and AI, providing a practical tool for evaluating trajectory-based systems.
The authors tackled the problem of measuring closeness between sets of trajectories, which lacked metrics that were both mathematically consistent and practical, by proposing a new metric that is computationally efficient, optimally handles trajectory identity confusion, and is mathematically rigorous.
Metrics on the space of sets of trajectories are important for scientists in the field of computer vision, machine learning, robotics, and general artificial intelligence. However, existing notions of closeness between sets of trajectories are either mathematically inconsistent or of limited practical use. In this paper, we outline the limitations in the current mathematically-consistent metrics, which are based on OSPA (Schuhmacher et al. 2008); and the inconsistencies in the heuristic notions of closeness used in practice, whose main ideas are common to the CLEAR MOT measures (Keni and Rainer 2008) widely used in computer vision. In two steps, we then propose a new intuitive metric between sets of trajectories and address these limitations. First, we explain a solution that leads to a metric that is hard to compute. Then we modify this formulation to obtain a metric that is easy to compute while keeping the useful properties of the previous metric. Our notion of closeness is the first demonstrating the following three features: the metric 1) can be quickly computed, 2) incorporates confusion of trajectories' identity in an optimal way, and 3) is a metric in the mathematical sense.