A novel use of sparse coding is done for the on-line adaptation of HMM based ASR systems. The target is first sparse coded using OMP over exemplar/learned speaker dictionaries. Adapted model is obtained by the maximum likelihood scaling of the sparse coded target. Performance same as the existing techniques is obtained but with much lower complexity.