Kernel ridge regression for out-of-sample mapping in supervised manifold learning

详细信息	查看全文 | 推荐本文 |

• 作者：Carlotta Orsenigo ; ^{carlotta.orsenigo@polimi.it} ; Carlo Vercellis ^{carlo.vercellis@polimi.it}
• 关键词：Supervised manifold learning ; Nonlinear dimensionality reduction ; Supervised isomap ; Kernel ridge regression ; Classification
• 刊名：Expert Systems with Applications
• 出版年：2012
• 期刊代码：62_09574174
• 类别：et
• 出版时间：July, 2012
• 卷：39
• 期：9
• 页码：7757-7762
• 文件大小：262 K

摘要

Manifold learning methods for unsupervised nonlinear dimensionality reduction have proven effective in the visualization of high dimensional data sets. When dealing with classification tasks, supervised extensions of manifold learning techniques, in which class labels are used to improve the embedding of the training points, require an appropriate method for out-of-sample mapping.

In this paper we propose multi-output kernel ridge regression (KRR) for out-of-sample mapping in supervised manifold learning, in place of general regression neural networks (GRNN) that have been adopted by previous studies on the subject. Specifically, we consider a supervised agglomerative variant of Isomap and compare the performance of classification methods when the out-of-sample embedding is based on KRR and GRNN, respectively. Extensive computational experiments, using support vector machines and k-nearest neighbors as base classifiers, provide statistical evidence that out-of-sample mapping based on KRR consistently dominates its GRNN counterpart, and that supervised agglomerative Isomap with KRR achieves a higher accuracy than direct classification methods on most data sets.