Arabian Deaf and Dumb Communication system using wireless Flexible Sensor

Document Type : Research articles

Author

Department of Biomedical Engineering, Higher Technological Institute, 10th of Ramadan, Egypt.

Abstract

The deaf and dumb is the most pathological case which leads to various economic and social problems. So, it is important to develop an economical tool to facilitate an efficient communication between Arabian deaf-dumb, and normal persons. As those people depend on using hand gestures to contact with others .On other hand, Arabs use expressions not alphabet in their communication .In this work, a mobile smart system based on two stages is designed. First ,creating a digital code for the hand gestures using gloves flex sensors equipped with a three-axis accelerometer and a microcontroller. The digital results are compared to the corresponding wards stored in database .Then , translation of the matching ward into both written text and voice. Second, the newly developed system allows Arabian deaf to translate words of ordinary people into gestures using a speech recognition system .The accuracy was over90 % without the need for a webcam, coloured gloves, or online translator. This protocol can be used with for android systems in addition to ordinary computer systems.

Keywords