Sign Language Recognition


This project was inspired by a Master's student work (Miss. Ankita Saxena) at Center for Electronic Engineering Research Institute, Pilnai Govt. of India. I tried to repleicate an automatic sign language recogniton system developed by Ankita.

Sign language is used as a communication medium among deaf & dumb people to convey the message with normal person. A person who can talk and hear properly (normal person) cannot communicate with deaf & dumb person unless he/she is familiar with sign language. Same case is applicable when a deaf & dumb person wants to communicate with a normal person or blind person. In order to bridge the gap in communication among deaf & dumb community and normal community, Video Relay Service (VRS) is being used nowadays. In VRS a manual interpreter translates the hand signs to voice and vice versa to help communication at both ends. A lot of research work has been carried out to automate the process of sign language interpretation with the help of image processing and pattern recognition techniques.

A lot of researchers initially used morphological operations to detect hand from image frames. It is an important research area not only from engineering point of view but also for its impact on the society. Sign languages are non verbal visual languages, different from spoken languages, but they serve the same function. There are different sign languages all over the world such as American Sign Language (ASL), British Sign Language (BSL), Japanese Sign Language family, French Sign Language family, Australian Sign Language, Indian Sign Language (ISL) etc.