João Bimbo

Guilherme Ribeiro, Iordanis Antypas, Leonardo Bizzaro et al.

Ensuring safety and reliability in human-robot interaction (HRI) requires the timely detection of unexpected events that could lead to system failures or unsafe behaviours. Anomaly detection thus plays a critical role in enabling robots to recognize and respond to deviations from normal operation during collaborative tasks. While reconstruction models have been actively explored in HRI, approaches that operate directly on feature vectors remain largely unexplored. In this work, we propose MADRI, a framework that first transforms video streams into semantically meaningful feature vectors before performing reconstruction-based anomaly detection. Additionally, we augment these visual feature vectors with the robot's internal sensors' readings and a Scene Graph, enabling the model to capture both external anomalies in the visual environment and internal failures within the robot itself. To evaluate our approach, we collected a custom dataset consisting of a simple pick-and-place robotic task under normal and anomalous conditions. Experimental results demonstrate that reconstruction on vision-based feature vectors alone is effective for detecting anomalies, while incorporating other modalities further improves detection performance, highlighting the benefits of multimodal feature reconstruction for robust anomaly detection in human-robot collaboration.

M. Mahdi Ghazaei Ardakani, Joao Bimbo, Domenico Prattichizzo

Planar sliding of objects is modeled and analyzed. The model can be used for non-prehensile manipulation of objects lying on a surface. We study possible motions generated by frictional contacts, such as those arising between a soft finger and a flat object on a table. Specifically, using a quasi-static analysis we are able to derive a hybrid dynamical system to predict the motion of the object. The model can be used to find fixed-points of the system and the path taken by the object to reach such configurations. Important information for planning, such as the conditions in which the object sticks to the friction patch, pivots, or completely slides against it are obtained. Experimental results confirm the validity of the model for a wide range of applications.

Shan Luo, Joao Bimbo, Ravinder Dahiya et al.

Touch sensing can help robots understand their sur- rounding environment, and in particular the objects they interact with. To this end, roboticists have, in the last few decades, developed several tactile sensing solutions, extensively reported in the literature. Research into interpreting the conveyed tactile information has also started to attract increasing attention in recent years. However, a comprehensive study on this topic is yet to be reported. In an effort to collect and summarize the major scientific achievements in the area, this survey extensively reviews current trends in robot tactile perception of object properties. Available tactile sensing technologies are briefly presented before an extensive review on tactile recognition of object properties. The object properties that are targeted by this review are shape, surface material and object pose. The role of touch sensing in combination with other sensing sources is also discussed. In this review, open issues are identified and future directions for applying tactile sensing in different tasks are suggested.