A fully automatic method for recognizing hand configurations of Brazilian sign language
Costa Filho, Cicero Ferreira Fernandes, Souza, Robson Silva de, Santos, Jonilson Roque dos, Santos, Bárbara Lobato dos, Costa, Marly Guimarães Fernandes
Res. Biomed. Eng.
DATA DE PUBLICAÇÃO
Abstract Introduction Sign language is a collection of gestures, postures, movements, and facial expressions used by deaf people. The Brazilian sign language is Libras. The use of Libras has been increased among the deaf communities, but is still not disseminated outside this community. Sign language recognition is a field of research, which intends to help the deaf community communication with non-hearing-impaired people. In this context, this paper describes a new method for recognizing hand configurations of Libras - using depth maps obtained with a Kinect® sensor. Methods The proposed method comprises three phases: hand segmentation, feature extraction, and classification. The segmentation phase is independent from the background and depends only on pixel value. The feature extraction process is independent from rotation and translation. The features are extracted employing two techniques: (2D)2LDA and (2D)2PCA. The classification employs two classifiers: a novelty classifier and a KNN classifier. A robust database is constructed for classifier evaluation, with 12,200 images of Libras and 200 gestures of each hand configuration. Results The best accuracy obtained was 96.31%. Conclusion The best gesture recognition accuracy obtained is much higher than the studies previously published. It must be emphasized that this recognition rate is obtained for different conditions of hand rotation and proximity of the depth camera, and with a depth camera resolution of only 640×480 pixels. This performance must be also credited to the feature extraction technique, and to the size standardization and normalization processes used previously to feature extraction step.
- A robust fully automatic lumen segmentation method for in vivo intracoronary optical coherence tomography
- Recognition of altered segments in Brazilian Sign Language
- TRANSCULTURAL ADAPTATION OF THE SELF-EVALUATION INSTRUMENT OF OCCUPATIONAL OPERATION FOR BRAZILIAN SIGN LANGUAGE
- Alien hand sign or alien hand syndrome?
- Mathematical knowledge and language in deaf students: The relationship between the recitation of a numerical sequence and Brazilian Sign Language proficiency