A new deep neural network based on a stack of single-hidden-layer feedforward neural networks with randomly fixed hidden neurons

详细信息    查看全文

• 作者：Junying Hu ^{hujunyingmm@163.com" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Jiangshe Zhang ; ^{jszhang@mail.xjtu.edu.cn" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Chunxia Zhang ^{cxzhang@mail.xjtu.edu.cn" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Juan Wang ^{Wangjuan03022204@163.com" class="auth_mail" title="E-mail the corresponding author}Author Vitae
• 关键词：Single-hidden layer feedforward neural network ; Manifold regularization ; Unsupervised learning ; Embedding ; Stackable structure
• 刊名：Neurocomputing
• 出版年：2016
• 出版时间：1 January 2016
• 年：2016
• 卷：171
• 期：Complete
• 页码：63-72
• 全文大小：1137 K

文摘

Single-hidden layer feedforward neural networks with randomly fixed hidden neurons (RHN-SLFNs) have been shown, both theoretically and experimentally, to be fast and accurate. Besides, it is well known that deep architectures can find higher-level representations, thus can potentially capture relevant higher-level abstractions. But most of current deep learning methods require a long time to solve a non-convex optimization problem. In this paper, we propose a stacked deep neural network, St-URHN-SLFNs, via unsupervised RHN-SLFNs according to stacked generalization philosophy to deal with unsupervised problems. Empirical study on a wide range of data sets demonstrates that the proposed algorithm outperforms the state-of-the-art unsupervised algorithms in terms of accuracy. On the computational effectiveness, the proposed algorithm runs much faster than other deep learning methods, i.e. deep autoencoder (DA) and stacked autoencoder (SAE), and little slower than other methods.