Digital Image Processing

P. V. V. Kishore ¹, P. Rajesh Kumar ², A. Arjuna Rao ³

Affiliations
1 Andhra University, College of Engineering, Visakhapatnam, Andhra Pradesh, IN
2 Department of ECE, Andhra University, College of Engineering, Visakhapatnam, AP, IN
3 Miracle Educational Society Group of Institutions, Boghapuram, Vizianagaram, Andhra Pradesh, IN

Abstract

The paper presents a system developed for recognizing gestures of Indian sign language from images of gestures. The proposed system is based on Elliptical Fourier descriptors and neural networks used for gesture pattern recognition. Unlike the systems proposed by other researchers such as using a radio frequency or colored gloves to achieve the recognition our system does not impose any such constraints. Features are extracted from the videos of signers using elliptical Fourier descriptors and principal component analysis which greatly reduces the size of the feature vector. Neural networks error back propagation algorithm is used to recognize gestures Indian sign language. The system converts the recognized gesture in to voice and text messages. The system was implemented with 440 sample videos of gestures of alphanumeric characters and words with a maximum of 5 videos per gesture. Experimental results show that the neural network is able to recognize gestures and convert them to voice messages with an accuracy of 92.52%.

Keywords

Sign Language Recognition, Artificial Neural Networks, Elliptical Fourier Descriptors, Canny Edge Detector.

Full Text