Quadratic kernel-free least squares support vector machine for target diseases classification

详细信息    查看全文

• 作者：Yanqin Bai ; Xiao Han ; Tong Chen ; Hua Yu
• 关键词：Classification problem ; Least squares support vector machine ; Consensus ; Quadratic kernel ; free least squares support vector machine ; Alternating direction method of multipliers
• 刊名：Journal of Combinatorial Optimization
• 出版年：2015
• 出版时间：November 2015
• 年：2015
• 卷：30
• 期：4
• 页码：850-870
• 全文大小：1,195 KB
• 参考文献：Al-Bashish D, Bani-Ahmad S, Braik M (2011) Detection and classification of leaf diseases using k-means based segmentation and neural networks based classification. Inf Technol J 10(2):267鈥?75CrossRef
  Baesensl B, Viaenel S, Van Gestel T, Suykens JA, Dedene G, De Moor B, Vanthienen J (2000) An empirical assessment of kernel type performance for least squares support vector machine classifiers. Fourth international conference on knowledge-based. lntelligent engineerg systems & allied technologies, vol 1, pp 313鈥?16
  Bai Y, Chen Y, Niu B (2013) New sdp models for protein homology detection with semi-supervised SVM. Optimization 62(4):561鈥?72MATH MathSciNet CrossRef
  Bai Y, Niu BL, Chen Y (2012) Sdp relaxation for semi-supervised support vector machine. Pac J Optim 8(1):3鈥?4MATH MathSciNet
  Bai Y, Shen K, Shen Y (2014) Consensus proximal support vector machine for classification. J Oper Res Soc China 2:57鈥?4MATH MathSciNet CrossRef
  Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2010) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3:1鈥?22MATH CrossRef
  Chen W, Tian YJ (2010) \(l_{p}\) -norm proximal support vector machine and its applications. Proc Comput Sci 1:2417鈥?423CrossRef
  Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273鈥?97MATH
  Deng N, Zhang C, Tian Y (2012) Suppport vector machines: optimization based theory, algorithms and extensions. CRC Press, Boca Raton
  Fung G, Mangasarian O (2001) Proximal support vector machine classifiers. In: Proceedings KDD-2001: knowledge discovery and data mining, San Francisco, pp 77鈥?6
  Gu G, Yuan X, He B (2014) Customized proximal point algorithms for linearly constrained convex minimization and saddle-point problems: a unified approach. Comput Optim Appl 59(1):135鈥?61MATH MathSciNet CrossRef
  Gu Y, Goh M, Chen QL, Souza RD, Tang GC (2013a) A new two-party bargaining mechanism. J Comb Optim 25(1):135鈥?63MATH MathSciNet CrossRef
  Gu Y, Fan J, Tang G, Zhong J (2013b) Maximum latency scheduling problem on two-person cooperative games. J Comb Optim 26(1):71鈥?1MATH MathSciNet CrossRef
  He B, Tao M, Yuan X (2012) Alternating direction method with gaussian back substitution for separable convex programming. SIAM J Optim 22(2):313鈥?40MATH MathSciNet CrossRef
  Huang K, Yang H, King I, Lyu MR, Chan L (2004) Biased minimax probability machine for medical diagnosis. Artif Intell Math, pp 111鈥?18
  Dagher I (2008) Quadratic kernel-free non-linear support vector machine. J Global Optim 41(1):15鈥?0MATH MathSciNet CrossRef
  Lathia J (2014) Modeling mayhem: predicting invasion and proliferation kinetics in idh1 mutant glioblastoma with mathematical models. Neuro-Oncology 16(6):763鈥?64CrossRef
  Jayadeva J, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905鈥?10CrossRef
  Liang Y, Liu C, Luan C, Leung KS, Chan TM, Xu ZB, Zhang H (2013) Sparse logistic regression with a \(l_{_{1/2}}\) penalty for gene selection in cancer classification. BMC Bioinf 14(1):198CrossRef
  Mangasarian O, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28:69鈥?4CrossRef
  Rani K (2011) Analysis of heart diseases dataset using neural network approach. Int J Data Min Knowl Manag Process 1(5):1鈥?CrossRef
  Rumpf T, Mahlein A, Steiner U, Oerke EC, Dehne HW, Pl眉mer L (2010) Early detection and classification of plant diseases with support vector machines based on hyperspectral reflectance. Comput Electron Agric 74(1):91鈥?9CrossRef
  Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293鈥?00MathSciNet CrossRef
  Tian Y, Qi Z (2014) Review on: twin support vector machines. Ann Data Sci 1(2):253鈥?77MathSciNet CrossRef
  Vapnik VN, Vapnik V (1998) Statistical learning theory. Wiley, New York
  Zhong L, Luo S, Wu L, Xu L, Yang J, Tang G (2014) A two-stage approach for surgery scheduling. J Comb Optim 27(3):545鈥?56MATH MathSciNet CrossRef
  Zhou Z, Jiang Y (2004) Nec4.5: neural ensemble based c4.5. IEEE Trans Knowl Data Eng 16(6):770鈥?73MathSciNet CrossRef
  
• 作者单位：Yanqin Bai (1)
  Xiao Han (1)
  Tong Chen (2)
  Hua Yu (2)
  
  1. Department of Mathematics, Shanghai University, Shanghai, 200444, China
  2. Shanghai General Hospital, School of Medicine, Shanghai Jiaotong University, Shanghai, 200080, China
  
• 刊物类别：Mathematics and Statistics
• 刊物主题：Mathematics
  Combinatorics
  Convex and Discrete Geometry
  Mathematical Modeling and IndustrialMathematics
  Theory of Computation
  Optimization
  Operation Research and Decision Theory
  
• 出版者：Springer Netherlands
• ISSN：1573-2886

文摘

Support vector machines (SVMs) have been proved effective and promising techniques for classification problem. Recently, SVMs have been successfully applied to target diseases classification and prediction by using real-world data. In this paper, we propose a new quadratic kernel-free least squares support vector machine (QLSSVM) for binary classification problem. The model of QLSSVM is a convex quadratic programming problem with an advantage of kernel-free, compared with the existed least squares SVM. By using consensus technique, the decision variables of QLSSVM are split into local variable and global variable. Then the QLSSVM is converted into the consensus QLSSVM and solved by alternating direction method of multipliers with a Gaussian back substitution. Finally, our QLSSVM is illustrated in terms of numerical tests based on two types of training data sets. The first numerical test is implemented based on artificial data to certify the performance of our QLSSVM. To apply our QLSSVM to disease classification, the second one is implemented based on diseases data set from University of California, Irvine, Machine Learning Repository to demonstrates that our model has higher classification accuracy compared with several existed methods. In particularly, our numerical example is implemented based on a special heart disease data set provided by Hungarian heart disease database to illustrates the effectiveness of our QLSSVM for a particular disease diagnosis. Keywords Classification problem Least squares support vector machine Consensus Quadratic kernel-free least squares support vector machine Alternating direction method of multipliers