A Global-best Harmony Search based Gradient Descent Learning FLANN (GbHS-GDL-FLANN) for data classification

详细信息    查看全文

• 作者：Bighnaraj Naik ; ^{mailtobnaik@gmail.com" class="auth_mail" title="E-mail the corresponding author} ; Janmenjoy Nayak ^{mailforjnayak@gmail.com" class="auth_mail" title="E-mail the corresponding author} ; Himansu Sekhar Behera ^{mailtohsbehera@gmail.com" class="auth_mail" title="E-mail the corresponding author}
• 关键词：Classification ; Functional link artificial neural network ; Gradient descent learning ; Harmony search ; Global-best Harmony Search
• 刊名：Egyptian Informatics Journal
• 出版年：2016
• 出版时间：March 2016
• 年：2016
• 卷：17
• 期：1
• 页码：57-87
• 全文大小：3204 K

文摘

While dealing with real world data for classification using ANNs, it is often difficult to determine the optimal ANN classification model with fast convergence. Also, it is laborious to adjust the set of weights of ANNs by using appropriate learning algorithm to obtain better classification accuracy. In this paper, a variant of Harmony Search (HS), called Global-best Harmony Search along with Gradient Descent Learning is used with Functional Link Artificial Neural Network (FLANN) for classification task in data mining. The Global-best Harmony Search (GbHS) uses the concepts of Particle Swarm Optimization from Swarm Intelligence to improve the qualities of harmonies. The problem solving strategies of Global-best Harmony Search along with searching capabilities of Gradient Descent Search are used to obtain optimal set of weight for FLANN. The proposed method (GbHS-GDL-FLANN) is implemented in MATLAB and compared with other alternatives (FLANN, GA based FLANN, PSO based FLANN, HS based FLANN, Improved HS based FLANN, Self Adaptive HS based FLANN, MLP, SVM and FSN). The GbHS-GDL-FLANN is tested on benchmark datasets from UCI Machine Learning repository by using 5-fold cross validation technique. The proposed method is analyzed under null-hypothesis by using Friedman Test, Holm and Hochberg Procedure and Post-Hoc ANOVA Statistical Analysis (Tukey Test & Dunnett Test) for statistical analysis and validity of results. Simulation results reveal that the performance of the proposed GbHS-GDL-FLANN is better and statistically significant from other alternatives.