Towards Ubiquitous Intelligent Hand Interaction
This addresses the problem of developing practical natural user interfaces for mixed reality and IoT applications, but it appears incremental as it builds on existing concepts without new breakthroughs.
The paper tackles the limitations of current hand tracking systems, which are confined to first-person vision-based solutions and suffer from optical artifacts, by proposing a research framework for achieving ubiquitous intelligent hand interaction, but does not provide concrete results or numbers.
The development of ubiquitous computing and sensing devices has brought about novel interaction scenarios such as mixed reality and IoT (e.g., smart home), which pose new demands for the next generation of natural user interfaces (NUI). Human hand, benefit for the large degree-of-freedom, serves as a medium through which people interact with the external world in their daily lives, thus also being regarded as the main entry of NUI. Unfortunately, current hand tracking system is largely confined on first perspective vision-based solutions, which suffer from optical artifacts and are not practical in ubiquitous environments. In my thesis, I rethink this problem by analyzing the underlying logic in terms of sensor, behavior, and semantics, constituting a research framework for achieving ubiquitous intelligent hand interaction. Then I summarize my previous research topics and illustrated the future research directions based on my research framework.