A novel multi-sensor framework is proposed for Sign Language Recognition (SLR). The framework recognize dynamic sign words performed by hearing impaired persons. A recognition combination framework using Coupled-HMM (CHMM) is proposed for SLR. Results shows higher accuracy on CHMM over uni-modal and other fusion approaches.