Two-stage extreme learning machine for high-dimensional data

详细信息    查看全文

• 作者：Peng Liu ; Yihua Huang ; Lei Meng ; Siyuan Gong…
• 关键词：Spectral regression (SR) ; Extreme learning machine (ELM) ; High ; dimensional data ; Dimensionality reduction (DR)
• 刊名：International Journal of Machine Learning and Cybernetics
• 出版年：2016
• 出版时间：October 2016
• 年：2016
• 卷：7
• 期：5
• 页码：765-772
• 全文大小：627 KB
• 刊物类别：Engineering
• 刊物主题：Artificial Intelligence and Robotics
  Statistical Physics, Dynamical Systems and Complexity
  Computational Intelligence
  Control , Robotics, Mechatronics
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1868-808X
• 卷排序：7

文摘

Extreme learning machine (ELM) has been proposed for solving fast supervised learning problems by applying random computational nodes in the hidden layer. Similar to support vector machine, ELM cannot handle high-dimensional data effectively. Its generalization performance tends to become bad when it deals with high-dimensional data. In order to exploit high-dimensional data effectively, a two-stage extreme learning machine model is established. In the first stage, we incorporate ELM into the spectral regression algorithm to implement dimensionality reduction of high-dimensional data and compute the output weights. In the second stage, the decision function of standard ELM model is computed based on the low-dimensional data and the obtained output weights. This is due to the fact that two stages are all based on ELM. Thus, output weights in the second stage can be approximately replaced by those in the first stage. Consequently, the proposed method can be applicable to high-dimensional data at a fast learning speed. Experimental results show that the proposed two-stage ELM scheme tends to have better scalability and achieves outstanding generalization performance at a faster learning speed than ELM.