Zhengtao Hu

Hao Chen, Takuya Kiyokawa, Zhengtao Hu et al.

Grasping unknown objects from a single view has remained a challenging topic in robotics due to the uncertainty of partial observation. Recent advances in large-scale models have led to benchmark solutions such as GraspNet-1Billion. However, such learning-based approaches still face a critical limitation in performance robustness for their sensitivity to sensing noise and environmental changes. To address this bottleneck in achieving highly generalized grasping, we abandon the traditional learning framework and introduce a new perspective: similarity matching, where similar known objects are utilized to guide the grasping of unknown target objects. We newly propose a method that robustly achieves unknown-object grasping from a single viewpoint through three key steps: 1) Leverage the visual features of the observed object to perform similarity matching with an existing database containing various object models, identifying potential candidates with high similarity; 2) Use the candidate models with pre-existing grasping knowledge to plan imitative grasps for the unknown target object; 3) Optimize the grasp quality through a local fine-tuning process. To address the uncertainty caused by partial and noisy observation, we propose a multi-level similarity matching framework that integrates semantic, geometric, and dimensional features for comprehensive evaluation. Especially, we introduce a novel point cloud geometric descriptor, the C-FPFH descriptor, which facilitates accurate similarity assessment between partial point clouds of observed objects and complete point clouds of database models. In addition, we incorporate the use of large language models, introduce the semi-oriented bounding box, and develop a novel point cloud registration approach based on plane detection to enhance matching accuracy under single-view conditions. Videos are available at https://youtu.be/qQDIELMhQmk.

Peihao Shi, Zhengtao Hu, Kazuyuki Nagata et al.

This paper proposes an adaptive pin-array fixture. The key idea of this research is to use the shape-memorable mechanism of pin array to fix multiple different shaped parts with common pin configuration. The clamping area consists of a matrix of passively slid-able pins that conform themselves to the contour of the target object. Vertical motion of the pins enables the fixture to encase the profile of the object. The shape memorable mechanism is realized by the combination of the rubber bush and fixing mechanism of a pin. Several physical peg-in-hole tasks is conducted to verify the feasibility of the fixture.

Zhengtao Hu, Weiwei Wan, Kensuke Harada

This work designs a mechanical tool for robots with 2-finger parallel grippers, which extends the function of the robotic gripper without additional requirements on tool exchangers or other actuators. The fundamental kinematic structure of the mechanical tool is two symmetric parallelograms which transmit the motion of the robotic gripper to the mechanical tool. Four torsion springs are attached to the four inner joints of the two parallelograms to open the tool as the robotic gripper releases. The forces and transmission are analyzed in detail to make sure the tool reacts well with respect to the gripping forces and the spring stiffness. Also, based on the kinematic structure, variety tooltips were designed for the mechanical tool to perform various tasks. The kinematic structure can be a platform to apply various skillful gripper designs. The designed tool could be treated as a normal object and be picked up and used by automatically planned grasps. A robot may locate the tool through the AR markers attached to the tool body, grasp the tool by selecting an automatically planned grasp, and move the tool from any arbitrary pose to a specific pose to grip objects. The robot may also determine the optimal grasps and usage according to the requirements of given tasks.