We incorporate semantic features into LMs via theory of frame semantics.
We use deep autoencoders for noise robust encoding of semantic context.
Deep semantic encodings on target words are more noise robust.
Semantic LMs (SELMs) have a better recognition performance on target words.
SELMs have a better understanding performance on the frame identification task.