Datasets on object manipulation and interaction: a survey
This work provides a resource for researchers in robotics and computer vision by summarizing available datasets, but it is incremental as it does not introduce new data or methods.
The authors surveyed twenty recent datasets for object manipulation, reporting on their modalities, activities, and annotations to guide selection and creation.
A dataset is crucial for model learning and evaluation. Choosing the right dataset to use or making a new dataset requires the knowledge of those that are available. In this work, we provide that knowledge, by reviewing twenty datasets that were published in the recent six years and that are directly related to object manipulation. We report on modalities, activities, and annotations for each individual dataset and give our view on its use for object manipulation. We also compare the datasets and summarize them. We conclude with our suggestion on future datasets.