LightTact: A Visual-Tactile Fingertip Sensor for Deformation-Independent Contact Sensing
This work provides a novel sensing principle for tactile sensors, enabling robust detection of light-contact interactions that were previously difficult to perceive, which is valuable for robotic manipulation in unstructured environments.
LightTact introduces a visual-tactile fingertip sensor that detects contact without relying on surface deformation, enabling robust perception of light contacts with liquids, semi-liquids, and ultra-soft materials. The sensor achieves high-contrast raw images and accurate pixel-level contact segmentation, demonstrated in robotic tasks like water spreading and facial-cream dipping.
Contact often occurs without macroscopic surface deformation, such as during interaction with liquids, semi-liquids, or ultra-soft materials. However, most existing tactile sensors rely on deformation to infer contact, making such light-contact interactions difficult to perceive robustly. To address this, we present LightTact, a visual-tactile fingertip sensor that makes contact directly visible via a deformation-independent principle. LightTact features an ambient-blocking optical configuration that suppresses both external light and internal illumination at non-contact regions, while transmitting only the scattered light generated at true contacts. As a result, LightTact produces high-contrast raw images in which non-contact pixels remain near-black (mean gray value < 3) and contact pixels preserve the natural appearance of the contacting surface. Built on this, LightTact achieves accurate pixel-level contact segmentation that is robust to material properties, contact force, surface appearance, and environmental lighting. We further demonstrate that LightTact unlocks new robotic manipulation behaviors that require detection of extremely light contact, including water spreading, facial-cream dipping, and soft thin-film interaction. In addition, we show that LightTact's spatially aligned visual-tactile images can be directly interpreted by vision-language models.