Temporal Accumulative Features for Sign Language Recognition
This work addresses sign language recognition for accessibility applications, but it is incremental as it builds on existing methods with specific adaptations.
The paper tackles isolated sign language recognition by proposing temporal accumulative features (TAF) that incorporate sign language-specific constructs, resulting in improved classification results over baseline methods.
In this paper, we propose a set of features called temporal accumulative features (TAF) for representing and recognizing isolated sign language gestures. By incorporating sign language specific constructs to better represent the unique linguistic characteristic of sign language videos, we have devised an efficient and fast SLR method for recognizing isolated sign language gestures. The proposed method is an HSV based accumulative video representation where keyframes based on the linguistic movement-hold model are represented by different colors. We also incorporate hand shape information and using a small scale convolutional neural network, demonstrate that sequential modeling of accumulative features for linguistic subunits improves upon baseline classification results.