Attention-based Estimation and Prediction of Human Intent to augment Haptic Glove aided Control of Robotic Hand
This work addresses the problem of precise robotic hand control for in-hand manipulation, which is incremental as it builds on existing methods with specific enhancements.
The paper tackles the difficulty of mapping high-dimensional motion signals from a haptic glove to a robotic hand by proposing an estimation mechanism for human intent and a control algorithm for object relocation, achieving a 97.3-98.7% improvement in test-MSE for intent prediction compared to an LSTM benchmark.
The letter focuses on Haptic Glove (HG) based control of a Robotic Hand (RH) executing in-hand manipulation of certain objects of interest. The high dimensional motion signals in HG and RH possess intrinsic variability of kinematics resulting in difficulty to establish a direct mapping of the motion signals from HG onto the RH. An estimation mechanism is proposed to quantify the motion signal acquired from the human controller in relation to the intended goal pose of the object being held by the robotic hand. A control algorithm is presented to transform the synthesized intent at the RH and allow relocation of the object to the expected goal pose. The lag in synthesis of the intent in the presence of communication delay leads to a requirement of predicting the estimated intent. We leverage an attention-based convolutional neural network encoder to predict the trajectory of intent for a certain lookahead to compensate for the delays. The proposed methodology is evaluated across objects of different shapes, mass, and materials. We present a comparative performance of the estimation and prediction mechanisms on 5G-driven real-world robotic setup against benchmark methodologies. The test-MSE in prediction of human intent is reported to yield ~ 97.3 -98.7% improvement of accuracy in comparison to LSTM-based benchmark