面向聚类分析的自适应弹性网络算法研究
|
摘要
弹性网络算法是一种启发式算法,最初被提出是用来解决TSP(Traveling Salesman Problem)问题的,现如今,被广泛应用于聚类问题中,尤其对于高维空间数据聚类方面,有很大的优势。提出了一种新的自适应弹性网络算法(Adaptive Elastic Net,AEN)解决聚类问题,该算法利用弹性网络算法得到的K个中心点作为聚类初始中心点,并利用局部搜索择优算法在每次迭代中更新中心点。以聚类完成后每一簇的中心点到该簇元素的距离之和作为聚类质量评价标准,分别对随机生成的不同维度的50,100,300,500,1 000个数据点的数据集和UCI中多个标准数据集进行聚类,并将结果与传统聚类算法的聚类结果进行比较。实验表明:相较于传统的聚类算法,该算法可以有效地提高聚类质量。
The elastic net algorithm as a heuristic method initially applied to solve the traveling salesman problem, can be used as a tool for data clustering in n-dimensional space. In this paper, a new Elastic Net Approach(AEN)is proposed to solve the cluster analysis problem. The algorithm gets K points as the initial centroids and updates the centroids according to the local search preferred algorithm in each iteration. Simulation results are provided for instances of up to 1,000 points randomly generated in different dimensions, illustrating that the proposed method performs better than the traditional clustering algorithms in solution quality.
The elastic net algorithm as a heuristic method initially applied to solve the traveling salesman problem, can be used as a tool for data clustering in n-dimensional space. In this paper, a new Elastic Net Approach(AEN)is proposed to solve the cluster analysis problem. The algorithm gets K points as the initial centroids and updates the centroids according to the local search preferred algorithm in each iteration. Simulation results are provided for instances of up to 1,000 points randomly generated in different dimensions, illustrating that the proposed method performs better than the traditional clustering algorithms in solution quality.
引文
[1]Baldi P,Hatfield G W.DNA microarrays and gene expression[M].[S.l.]:Cambridge Univ Press,2002.
[2]Wu S,Liew A W C,Yan H,et al.Cluster analysis of gene expression database on self-splitting and merging competitive learning[J].IEEE Trans on Information Technology in Biomedicine,2004,8(1).
[3]Frigui H,Krishnapuram R.A robust competitive clustering algorithm with applications in computer vision[J].IEEE Trans on Pattern Analysis and Machine Intelligence,1999,21(5):450-465.
[4]Shi J,Malik J.Normalized cuts and image segmentation[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2000,22(8):888-905.
[5]Xu R.Survey of clustering algorithm[J].IEEE Transactions on Neural Networks,2005,16:645-678.
[6]Kohonen T.Self-organized formation of the topologically correct feature maps[J].Biological Cybernetics,1982,43:59-69.
[7]Durbin R,Willshaw D.An analogue approach to the traveling salesman problem using an elastic net approach[J].Nature,1987,326:689-691.
[8]Alahakoon D,Halgamuge S K.Dynamic self-organizing maps with controlled growth for knowledge discovery[J].IEEE Trans on Neural Networks,2000,11(3):601-614.
[9]Raube A,Merkl D.The growing hierarchical self-organizing map:exploratory analysis of high-dimensional data[J].IEEE Transactions on Neural Networks,2002,13(6):1331-1340.
[10]Vakhutinsky A I,Golden B L.The co-adaptive neural network approach to the Euclidean traveling salesman problem[J].Neural Networks,2003,16(10):1499-1525.
[11]Lenstra J K.Clustering a data array and the traveling salesman problem[J].Operations Research,1974,22(2):413-414.
[12]Lenstra J K,Rinnooy Kan A H G.Some simple applications of the traveling salesman problem[J].Operational Research Quarterly,1975,26(4):717-733.
[13]Climer S,Zhang Weixiong.Rearrangement clustering:pitfalls,remedies,and applications[J].Journal of Machine Learning Research,2006,7:919-943.
[14]Riche N H,Fekete J D.Matrix Explorer:a dual-representation system to explore social networks[J].IEEE Trans on Vis Comput Graph,2006,12(5):677-684.
[15]Tsai C W,Lin T H,Chiang M C.Automatic elastic net clustering algorithm[C]//2014 IEEE International Conference on Systems,Man,and Cybernetics(SMC),2014:2768-2773.
[16]Kim J W,Choi Y,Lee D,et al.Intelligent MADS with clustering and elastic net and its application to optimal design of interior PM synchronous machines[J].IEEE Transactions on Magnetics,2013,49(5):2209-2212.
[2]Wu S,Liew A W C,Yan H,et al.Cluster analysis of gene expression database on self-splitting and merging competitive learning[J].IEEE Trans on Information Technology in Biomedicine,2004,8(1).
[3]Frigui H,Krishnapuram R.A robust competitive clustering algorithm with applications in computer vision[J].IEEE Trans on Pattern Analysis and Machine Intelligence,1999,21(5):450-465.
[4]Shi J,Malik J.Normalized cuts and image segmentation[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2000,22(8):888-905.
[5]Xu R.Survey of clustering algorithm[J].IEEE Transactions on Neural Networks,2005,16:645-678.
[6]Kohonen T.Self-organized formation of the topologically correct feature maps[J].Biological Cybernetics,1982,43:59-69.
[7]Durbin R,Willshaw D.An analogue approach to the traveling salesman problem using an elastic net approach[J].Nature,1987,326:689-691.
[8]Alahakoon D,Halgamuge S K.Dynamic self-organizing maps with controlled growth for knowledge discovery[J].IEEE Trans on Neural Networks,2000,11(3):601-614.
[9]Raube A,Merkl D.The growing hierarchical self-organizing map:exploratory analysis of high-dimensional data[J].IEEE Transactions on Neural Networks,2002,13(6):1331-1340.
[10]Vakhutinsky A I,Golden B L.The co-adaptive neural network approach to the Euclidean traveling salesman problem[J].Neural Networks,2003,16(10):1499-1525.
[11]Lenstra J K.Clustering a data array and the traveling salesman problem[J].Operations Research,1974,22(2):413-414.
[12]Lenstra J K,Rinnooy Kan A H G.Some simple applications of the traveling salesman problem[J].Operational Research Quarterly,1975,26(4):717-733.
[13]Climer S,Zhang Weixiong.Rearrangement clustering:pitfalls,remedies,and applications[J].Journal of Machine Learning Research,2006,7:919-943.
[14]Riche N H,Fekete J D.Matrix Explorer:a dual-representation system to explore social networks[J].IEEE Trans on Vis Comput Graph,2006,12(5):677-684.
[15]Tsai C W,Lin T H,Chiang M C.Automatic elastic net clustering algorithm[C]//2014 IEEE International Conference on Systems,Man,and Cybernetics(SMC),2014:2768-2773.
[16]Kim J W,Choi Y,Lee D,et al.Intelligent MADS with clustering and elastic net and its application to optimal design of interior PM synchronous machines[J].IEEE Transactions on Magnetics,2013,49(5):2209-2212.