A more reliable system for speechless patients to augment their limited communication abilities is presented in this paper. The normal person can¡¯t understand the sign language shown by speechless patients .To facilitate the communication for them, the sign language is converted into an audible message through gesture recognition. Two things need to be considered in sign language-one is movement of hands and other is position of fingers. This is measured using MEMS accelerometer and Flex sensors. Using Fuzzy logic based Classifier the sensor values are classified and the MSP430 microprocessor is pre-programmed so as to send text output which in turn is converted into an audible message using speakjet IC. All these components will be placed on a wearable glove which will be worn by the user of this system. Data analysis is done using LABVIEW software.