We combine maxout neurons with convolutional and LSTM structures for DNNs.
The optimal network structures and training strategies are explored for the models.
Experiments are carried out for 6 languages on the IARPA Babel data sets.
State-of-the-art results are achieved after system combination.