Discriminative Lasso

详细信息    查看全文

• 作者：Zhihong Zhang ; Jianbing Xiahou ; Zheng-Jian Bai ; Edwin R. Hancock…
• 关键词：Lasso ; Feature selection ; Feature graph ; ADMM
• 刊名：Cognitive Computation
• 出版年：2016
• 出版时间：October 2016
• 年：2016
• 卷：8
• 期：5
• 页码：847-855
• 全文大小：583 KB
• 刊物主题：Neurosciences; Computation by Abstract Devices; Artificial Intelligence (incl. Robotics); Computational Biology/Bioinformatics;
• 出版者：Springer US
• ISSN：1866-9964
• 卷排序：8

文摘

Lasso-type variable selection has been demonstrated to be effective in handling high-dimensional data. From the biological perspective, traditional Lasso-type models are capable of learning which stimuli are valuable while ignoring the many that are not, and thus perform feature selection. Traditional Lasso has the tendency to over-emphasize sparsity and to overlook the correlations between features. These drawbacks have been demonstrated to be critical in limiting its performance on real-world feature selection problems. Although some work has considered the problem of correlation, the issue of discriminative ability resulting from sparsity has been overlooked. To overcome this shortcoming, we propose a discriminative Lasso (referred to as dLasso) in which sparsity and correlation are jointly considered. Specifically, the new method can select features (or stimuli) that are correlated more strongly with the response but are less correlated with each other. Moreover, an efficient alternating direction method of multipliers (ADMM) is presented to solve the resulting sparse non-convex optimization problem. Extensive experiments on different datasets show that although our proposed model is not a convex problem, it outperforms both its approximately convex counterparts and a number of state-of-the-art feature selection methods.