Facial gesture interfaces for expression and communication
It tackles the problem of enabling intentional communication through facial gestures for users in HCI domains, but it is incremental as it reviews existing projects rather than presenting new results.
This paper reviews facial gesture interfaces that respond to deliberate facial actions for human-computer interaction, addressing applications such as text entry, artistic expression, and assistive technology for motor-impaired users.
Considerable effort has been devoted to the automatic extraction of information about action of the face from image sequences. Within the context of human-computer interaction (HCI) we may distinguish systems that allow expression from those which aim at recognition. Most of the work in facial action processing has been directed at automatically recognizing affect from facial actions. By contrast, facial gesture interfaces, which respond to deliberate facial actions, have received comparatively little attention. This paper reviews several projects on vision-based interfaces that rely on facial action for intentional HCI. Applications to several domains are introduced, including text entry, artistic and musical expression and assistive technology for motor-impaired users.