支撑矢量机理论与应用研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
统计学习理论是在有限样本下建立起来的统计学理论体系,而支撑矢量机是建立在统计学习理论的VC维理论和结构风险最小化原则上的一种非常有效的机器学习方法。支撑矢量机较好的解决了以往机器学习方法中存在的小样本、非线性、过学习、高维数、局部极小值点等实际问题,且具有很强的泛化性能。
     虽然统计学习理论和支撑矢量机有比较坚实的理论基础和良好的发展前景,但是对于支撑矢量机而言,还存在着以下尚未得到很好解决的问题:核函数和核参数的构造与选择缺乏理论指导、大规模样本集快速训练算法、多类支撑矢量机优化设计以及工程应用领域的拓展等。
     针对上述几个问题,本文开展了基于统计学习理论和支撑矢量机目标识别方法理论与应用的研究工作,主要包括以下几个方面的内容。
     (1)特征空间线性可分性。对于两类和多类目标识别问题,本文分别给出了观测样本在特征空间中线性可分的定义和充要条件。特别地,当核函数的Gram矩阵正定时,观测样本集在由核函数导出的高维特征空间中必然线性可分。
     (2)基于分类间隔的特征选择。对于两类和多类目标识别问题,本文依据各特征对分类间隔的贡献大小而定义了特征有效率,并提出了一种新的特征选择算法。该算法秉承了统计学习理论的理论基础——结构风险最小化,即要求选择出的特征子集能较好的兼顾分类能力和推广性能。
     (3)核函数自适应构造。本文根据观测样本在特征空间中线性可分条件,基于函数逼近论和核函数的基本性质,提出了自适应构造核函数的两种模型,即自适应多项式核函数和自适应B—Spline核函数,并给出了模型参数估计算法。
     (4)多类扩码支撑矢量机。本文通过扩展类别标示符编码,提出了一种新的多类扩码支撑矢量机——半对半算法。该多类支撑矢量机模型可以序贯求解,有效地降低了计算规模,也不存在判决“死区”。此外,本文还分析了多类目标扩码识别算法的推广性能。
     (5)分片支撑矢量机。本文提出了一种新的支撑矢量机模型——分片支撑矢量机。分片支撑矢量机不仅可以有效的处理高度复杂分布区域的识别问题,提高识别率和推广能力,而且可以大幅度降低计算量和存储容量。此外,本文还探讨了其推广能力的界。
     (6)基于支撑矢量机的广义相关K分布杂波检测。本文推导了广义相关K分布杂波高阶自相关矩函数,给出了杂波序列产生原理图,提出了模型参数解耦估计算法。将雷达杂波环境中信号检测问题转化为目标分类识别问题,基于支撑矢量机方法在广义K分布杂波背景下实现对目标的检测。
     最后对全文的工作进行总结,指出需要进一步深入研究和解决的问题。
Statistical learning theory (SLT) is a new statistical theory framework established from small samples, and support vector machines (SVM) is a novel powerful machines learning method based on VC dimension theory and structural risk minimization (RSM) principle, which are the important foundation in SLT. SVM has good generalization capability, and also has solved some practical problems such as small samples, nonlinearity, over learning, high dimension and local minimum point etc, which exit in most of the traditional machines learning method.
     Although, SLT and SVM have very stabile theory foundation and good development foreground, but there still are some problems in SVM which have not been well solved. For example, the kernel fimction adaptive construction and selection, fast training arithmetic, multi-class SVM model and expanding the application field etc.
     To deal with the above-mentioned problems, this dissertation has carefully studied the pattern recognition theory and application based on SLT and SVM, the main work andnovel results in this thesis are shown as followed.
     (1) To the binary and multi-class objects classification problem, the thesis differently gives out the strict definition and the distinguishable condition for separating the features by linear classification hyper surface in the feature space. Especially, when the Gram matrix of kernel function is strict positive, then the samples must be linear distinguishable in the feature space which is induced by the kernel function. The results are help to feature selection, kernel function construction and classifiers design.
     (2) To the binary and multi-class pattern recognition problem, in this thesis, the efficiency rate of features are defined by the contribution to classes margin of each feature, and a novel feature selection algorithm is put forward based on the feature efficiency rate. Because the new feature selection arithmetic is foundation on the RSM, so it can make good compromise between the classification capability and generalized capability, the performance of the new feature selection method, such as classification capability and generalized capability are improved obviously in contrast to the classical Relief method.
     (3) In this dissertation, a novel kernel function adaptive construction algorithm is put forward, which is based on the feature linear distinguishable condition, the function approaching theory and the properties of kernel function. This new kernel functions include the adaptive polynomial model and the B-Spline model, and the model parameters estimation method are also offered. The two kernel functions have the linear distinguishable and good generalized capability.
     (4) In this thesis, a new multi-class SVM model called Half-Versus-Half (H-V-H) method is put forward, which is based on increasing the dimension of decision space through extending the classes labels binary code. The new model can be sequentially solved and effectively improve the computational velocity, and it hasn't the region which is unable to test. In a addition, this dissertation has analyzed the generalized capability of H-V-H method.
     (5) A novel piecewise support vector machines (PSVM) model is provided in this thesis. The PSVM has decreased the complexity of pattern recognition, and improved the computational velocity some times by partitioning the feature space into several subspaces, and it can provide the ability to classify the samples with very complex distribution. Furthermore, this dissertation has analyzed the generalized capability of PSVM model.
     (6) In the dissertation, the nonlinear curve of autocorrelation coefficients is derived, and the generalized correlated K-distributed clutter simulation principle and the flow diagram are presented in the paper, then a novel model parameters estimation algorithm is also put forward through the parameter decoupling technology. Additional, this dissertation has applied SVM to detect the objects in generalized correlated K-distributed radar clutter.
     The problems needed further research and some personal ideas for developing SVM are pointed out in conclusion part.
引文
[1] 梁之舜,邓集贤,杨维权,司徒荣,邓永录著.概率论及数理统计(第二版).高等教育出版社,1988,5
    [2] 许建华,张学工译,Vladimir N.Vapnik著.统计学习理论.电子工业出版社,2004,6
    [3] 刘志刚,李德仁,秦前清,史文中.支撑向量机在多类分类问题中的推广.计算机工程与应用,2004,7,10-13
    [4] 徐勋华,王继成.支撑向量机的多类分类方法.微电子学与计算机,2004,21(10):149-152
    [5] 李昆仑,黄厚宽,田盛丰.模糊多类SVM模型.电子学报,2005,32(5):830-832
    [6] 唐发明,王仲冬,陈绵云.支撑向量机多类分类算法研究.控制与决策,2005,20(7):746-754
    [7] Weston J, Watkin C. Multi-class Support Vector Machines. Technical Report CSD-TR-98-04, Royal Holloway, University of London, Department of Computer Science, 1998
    [8] Chih-wei H, Chih-jen L. A Comparison of Methods for Multiclass Support Vector Machines. IEEE Trans. on Neural Networks, 2002, 13(2): 415-425
    [9] Platt J. Fast Training of Support Vector Machines Using Sequential Minimal Optimization. In: Scholkopf B, Burges C,ect. Advances in Kernel Methods: Support Vector Learning, MIT Press, 1999: 185-208
    [10] 粟塔山等著.最优化计算原理与算法程序设计.国防科技大学出版社,2001,1
    [11] 孙即祥等著.现代模式识别.国防科技大学出版社,2002,1
    [12] Kira K, Rendell L. The feature selection problem: Traditional methods and a new algorithm [A]. Proceedings of the Ninth National conference on Artificial Intelligence[C]. New Orleans: AAAI Press. 1992.129-134
    [13] 范劲松,方廷健.特征选择和提取要素的分析及其评价.计算机工程与应用,2001(13),95-99
    [14] 北京大学数学系几何与代数教研室代数小组编.高等代数.高等教育出版社,1995,2
    [15] Kononerko. Estimating attributes: analysis and extension of Relief. Proceedings of European conference on machine learning, 1994, pp. 171-182
    [16] 吴涛,贺汉根,贺明科,基于插值的核函数构造.计算机学报,2003,26(8),990-996
    [17] 王守觉.仿生模式识别(拓扑模式识别)——一种模式识别新模型的理论与应用.电 子学报,2002,30(10),1417-1420
    [18] Deon Garrett, David A. Peterson, Charles W. Anderson, Michael H. Thaut. Comparison of Linear, Nonlinear, and Feature Selection Methods for EEG Signal Classification. IEEE TRANS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING; VOL. 11, NO. 2, JUNE, 2003, 141-144
    [19] Li Zhang Gang Sun Jun Guo. Feature Selection for Pattern Classification Problems. Proceedings of the Fourth International Conference on Computer and Information Technology (CIT'04)
    [20] Nojun Kwak and Chong-Ho Choi. Input Feature Selection for Classification Problems. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 13, NO. 1, JANUARY 2002, 143-159
    [21] Huan Liu, Lei Yu. Toward Integrating Feature Selection Algorithms for Classification and Clustering. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING; VOL. 17, NO. 4, APRIL 2005, 491-502
    [22] 张丽新,王家,赵雁南,杨泽红.基于Relief的组合式特征选择.复旦学报(自然科学版),VOL.43,N0.5,Oct,2004,893-898
    [23] 王正明等著.弹道跟踪数据的校准与评估。国防科技大学出版社,1999,3
    [24] Scholkopf B. Support Vector Learning. PH.D thesis, Berlin University, 1997
    [25] N.Smith, M.Gales. Speech Recognition Using SVMS. IN: Advance in Neural Information Processing Systim 14. MIT Press. 2002
    [26] T. S. Jaakkola, M. Diekhans, D. Haussler. A Discriminative Framework for Detecting Remote Protein Homologies. J.Comp.Biol., 7: 95-114, 2000
    [27] David A. Shnidman, Generalized Radar Clutter Model. IEEE Trans On AES, July, 1999,Vol.35,No.3,857-865
    [28] Vassilis Anastassopoulos, George A. LamproP0ulos, A Generalized Compound Model for Radar Clutter. Proceedings of the IEEE National Radar Conference, Atlanta, 1994,3,29-31
    [29] V Anastassopoulos, G.. A. L ampropoulos, High Resolution Radar Clutter Statistic.IEEE Trans On AES, Vol.35, No.l, January, 1999, 43-59
    [30] 吕雁,史林,杨万海,SIRP法相干相关K分布雷达杂波的建模与仿真.现代雷达,2003(2),13-16
    [31] 曹晨,王小谟,关于雷达杂波性质研究的若干问题.现代雷达,2001(5),1-5
    [32] 蒋咏梅,陆铮,相关非高斯分布杂波的建模与仿真.系统工程与电子技术,1999,Vol。2l,No.10,27-30
    [33] Anastassopoulos V, Lampropoulos G.. A. High Resolution Radar Clutter Classification. Proceedings of the IEEE National Radar Conference, Washington, DC, May, 1995, 662-667
    [34] 张志勇,曹治国,张天序,相关Weibull分布雷达杂波的模拟.华中理工大学学报,1998,Vol.26,93-95
    [35] 申玉,陶然,单涛,相关对数正态分布雷达杂波的建模与仿真.火控雷达技术,2001(12),1-5
    [36] 王颖,毛二可,韩月秋,相关K分布的建模与仿真.信号处理,1997,Vol.13,No.2,141-146
    [37] 周月梅著,特殊函数概论.北京大学出版社,2000
    [38] L. James Marier, Jr. Correlated K-Distributed Clutter Generation for Radar Detection and Track. IEEE Trans On AES, Vol.31, No.2, 1995(4), 568-580
    [39] 边肇祺,张学工等著.模式识别(第二版).清华大学出版社,2000,1
    [40] S.S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy. A Fast Iterative Nearest Point Algorithm for SupportVector Machine Classifier Design. IEEE TRANS ON NEURAL NETWORKS, VOL. 11, NO. 1, JANUARY 2000, 124-136
    [41] V. N. Vapnik. The Nature of Statistical Learning Theory. New York: Springer-Verlag,1995
    [42] C. J. C. Borges. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, Vol. 2, No. 2, 1998, pp. 121-167
    [43] B. Scholkopf, A. Smola, R.C. Williamson, and RL. Bartlett. New support vector algorithms.Neural Computation, Vol. 12, 2000, pp. 1207-1245
    [44] D. J. Crisp and C. J. C. Burges. A Geometric Interpretation ofv-SVM Classifiers. NIPS 12, 2000, 244-250
    [45] C. Cortes and V. Vapnik. Support Vector Networks. Machine Learning, Vol. 20, No. 3, 1995, pp. 273-29
    [46] N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines. Cambridge University Press, 2000
    [47] V.N. Vapnik.An Overview of Statistical Learning Theory. IEEE Trans. on NN, Vol. 10, No. 5, Sept. 1999, pp. 988-999
    [48] J. Weston. Extension to the Support Vector Method. Ph.D. thesis, University of London, 1999
    [49] Eric Mjolsness and Dennis DeCoste. Machine Learning for Science: State of the Art and Future Prospects. Sicense, Vol. 293, Sept. 2001, pp. 2051-2055
    [50] Ling Zhang, Bo Zhang. A Geometrical Representation of McCulloch-Pitts Neural Model and Its Applications. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 4, JULY 1999.925-929
    [51] PING ZHONG, MASAO FUKUSHIMA. A NEW MULTI-CLASS SUPPORT VECTOR ALGORITHM. Optimization Methods and Software, Vol. 00, No. 00, Month 200x, 1-18
    [52] J.A.K. Suykens, T. Van Gestel, J. Vandewalle, B. De Moor. A Support Vector Machine Formulation to PCA Analysis and Its Kernel Version. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 14, NO. 2, MARCH 2003, 447-450
    [53] J. C. BURGES. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 2, 121-167 (1998)
    [54] ALEX J. SMOLA, BERNHARD SCHOLKOPF. A tutorial on support vector regression. Statistics and Computing 14: 199-222, 2004
    [55] Dong Chun-xi, Yang Shao-quan, Rao Xian, Tang Jian-long. An Algorithm of Estimating the Generalization Performance of RBF-SVM. Proceedings of the Fifth International Conference on Computational Intelligence and Multimedia Applications (ICCIMA'03)
    [56] Klaus-Robert Müller, Sebastian Mika, Gurmar Ratsch, Koji Tsuda, Bernhard Schrlkopf. An Introduction to Kernel-Based Learning Algorithms. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 12, NO. 2, MARCH 2001, 181-201
    [57] Vladimir N. Vapnik. An Overview of Statistical Learning Theory. IEEE TRANS ON NEURAL NETWORKS, VOL. 10, NO. 5, SEPTEMBER 1999, 988-999
    [58] TONY VAN GESTEL, JOHAN A.K. SUYKENS. Benchmarking Least Squares Support Vector Machine Classifiers. Machine Learning, 54, 2004, 5-32
    [59] Marc G. Genton. Classes of Kernels for Machine Learning: A Statistics Perspective. Journal of Machine Learning Research 2 (2001) 299-312
    [60] Bernhard Sch"olkopf, Kah-Kay Sung, Chris J. C. Burges, Federico Girosi. Comparing Support Vector Machines with GaussianKemels to Radial Basis Function Classifiers. IEEE TRANS ON SIGNAL PROCESSING; VOL. 45, NO. 11, NOVEMBER 1997, 2758-2765
    [61] David M. J. Tax, Robert P. W. Duin. Data Domain Description using Support Vectors. ESANN'1999 proceedings - European Symposium on Artificial Neural Networks Binges (Belgium), 21-23 April 1.999, D-Facto.public., ISBN 2-600049-9-X, pp. 251-256
    [62] Jinbo Bi, Kristin P. Bennett, Mark Embrechts. Dimensionality Reduction via Sparse Support Vector Machines. Journal of Machine Learning Research 1 (2002) 1-48
    [63] Fernando Pérez-Cruz, Angel Navia-Váquez, Aníbal R. Figueiras-Vidal. Empirical Risk Minimization for Support Vector Classifiers. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 14, NO. 2, MARCH 2003, 296-303
    [64] Tom Downs, Kevin E Gates, Annette Masters. Exact Simplification of Support Vector Solutions. Journal of Machine Learning Research 2 (2001) 293-297
    [65] Chun-Fu Lin, Sheng-De Wang. Fuzzy Support Vector Machines. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 13, NO. 2, MARCH 2002, 464-471
    [66] Han-Pang Huang, Yi-Hung Liu. Fuzzy Support Vector Machines for Pattern Recognition and Data Mining. International Journal of Fuzzy Systems, Vol. 4, No. 3, September 2002, 826-835
    [67] Yasemin Altun, Ioannis Tsochantaridis, Thomas Hofrnann. Hidden Markov Support Vector Machines. Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), Washington DC, 2003.
    [68] Davide Anguita, Andrea Boni. Improved Neural Network for SVM Learning. IEEE TRANS ON NEURAL NETWORKS, VOL. 13, NO. 5, SEPTEMBER 2002, 1243-1244
    [69] S.K. Shevade, S. S. Keerthi, C. Bhattacharyya, K. R. K. Murthy. Improvements to the SMO Algorithm for SVM Regression. IEEE TRANS ON NEURAL NETWORKS, VOL. 11, NO. 5, SEPTEMBER 2000, 1188-1193
    [70] Danny Roobaert. Improving the Generalization of Linear Support Vector Machines: an Application to 3D Object Recognition with Cluttered Background. Proceedings SVM workshop at the 16th International Joint Conference on Artificial Intelligence (IJCAI99) Stockholm, Sweden, August 1999
    [71] Bernhard Sch"olkopf, Sebastian Mika, Chris J. C. Burges, Philipp Knirsch. Input Space Versus Feature Spacein Kernel-Based Methods. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 5, SEPTEMBER 1999, 1000-1017
    [72] JING WU, JIAN-GUO ZHOU, PU-LIN YAN. Incremental proximal support vector classifier for multi-class classification. Proceeding of the Third International Conference On Machine Learning and Cybernetics, Shanghai, August, 2004, 26-29
    [73] O.L. Mangasarian, David R. Musicant. Lagrangian Support Vector Machines. Journal of Machine Learning Research 1 (2001) 161-177
    [74] J.A.K. SUYKENS, J. VANDEWALLE. Least Squares Support Vector Machine Classifiers. Neural Processing Letters 9: 1999, 293-300
    [75] Kristiaan Pelckmans, Johan A.K.Suykens. LS-SVMlab: a MATLAB/C toolbox for Least Squares Support Vector Machines, ht-tp://www.esat.kuleuven.ac.be/sista/lssvmlab.
    [76] Thorsten Joachims. Making Large-Scale SVM Learning Practical. Advances in Kernel Methods - Support Vector Learning. Bernhard Scholkopf, Christopher J. C. Burges, and Alexander J. Smola (eds.), MIT Press, Cambridge, USA, 1998.
    [77] Minh N. Nguyen Jagath C. Rajapakse. Multi-Class Support Vector Machines for Protein Secondary Structure Prediction. Genome Informatics 14: (2003), 218-227
    [78] Fei Sha, Lawrence K. Saul, Daniel D. Lee. Multiplicative updates for nonnegative quadraticprogramming in support vector machines, Technical Report MS-CIS-02-19 University of Pennsylvania
    [79] Bernhard Scholkopf, Alex J Smola. New Support Vector Algorithms. NeuroCOLT_Technical Report Series, NC2-TR-1998-031
    [80] C. H. Zheng G. W. Zheng L. C. Jiaol A. L. Ding. Multi-targets Recognition for High-Resolution Range Profile of Radar based on Fuzzy Support Vector Machine. Proceedings of the Fifth International Conference on Computational Intelligence and Multimedia Applications (ICCIMA'03)
    [81] Bernhard Sch"olkopf. Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation 10, (1998), 1299-1319
    [82] John Shawe-Taylor, Nello Cdstianini. On the Generalization of Soft Margin Algorithms. IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 48, NO. 10, OCTOBER 2002, 2721-2.735
    [83] 陶卿,齐红威,吴高巍,章显.η-one-class问题和η-outlier及其LP学习算法。计算机学报,Vol27,No.28,2004,1102-1108
    [84] HOI-MINGCHI and OKAN K. ERSOY. Recursive Update Algorithm for Least Squares Support Vector Machines. Neural Processing Letters 17: 2003, 165 - 173
    [85] Jiun-Hung Chen, Chu-Song Chen. Reducing SVM Classification Time Using Multiple Mirror Classifiers. IEEE TRANS ON SYSTEMS, MAN, AND CYBERNETICS—PART B: CYBERNETICS, VOL. 34, NO. 2, APRIL 2004, 1173-1183
    [86] Theodoros Evgeniou, Massimiliano Pontil, Tomaso Poggio. Regularization Networks and Support Vector Machines. Advances in Computational Mathematics 13 (2000) 1-50
    [87] Alex J. Smola, Thilo T. Frie, Bernhard Scholkopf. Semiparametrie Support Vector and Linear Programming Machines. NeuroCOLT2 Technical Report Series, NC2-TR-1998-024
    [88] Kristin P. Bennett. Semi-Supervised Support Vector Machines. Proceedings of Neural Information Processing Systems, Denver, 1998.
    [89] ROMAN GENOV. Silicon Support Vector Machine With On-line Learning. International Joumal of Pattern Recognition and Artificial Intelligence Vol. 17, No. 3 (2003) 385-404
    [90] Davide Mattera, Francesco Palmieri, Simon Haykin. Simple and Robust Methods for Support Vector Expansions. IEEE TRANS ON NEURAL NETWORKS, VOL. 10, NO. 5, SEPTEMBER 1999,1038-1047
    [91] Xiangying Wang. Statistical Learning Theory and State of the Art in SVM. Proceedings of the Second IEEE International Conference on Cognitive Informatics (ICCI'03)
    [92] Shai Avidan. Subset Selection for Efficient SVM Tracking. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'03)
    [93] Olvi L. Mangasarian and David R. Musicant. Successive Overrelaxation for Support Vector Machines. IEEE TRANS ON NEURAL NETWORKS, VOL. 10, NO. 5, SEPTEMBER 1999,1032-1037
    
    [94] R. Santiago-Mozos, J.M. Leiva-Murillo. Supervised-PCA and SVM Classifiers for Object Detection in Infrared Images. Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS'03)
    
    [95] Nello Cristianini. Support Vector and Kernel Machines.http://www.support-vector.net
    [96] Asa Ben-Hur, David Horn, Hava T. Siegelmann, Vladimir Vapnik. Support Vector Clustering. Journal of Machine Learning Research 2 (2001) 125-137
    [97] David M.J. Tax, Robert P.W. Duin. Support vector domain description. Pattern Recognition Letters, 20 (1999), 1191-1199
    
    [98] Yixin Chen, James Z. Wang,. Support Vector Learning for Fuzzy Rule-Based Classification Systems. IEEE TRANS ON FUZZY SYSTEMS, VOL. 11, NO. 6, DECEMBER 2003,716-728
    
    [99] Daniel J. Sebald, James A. Bucklew. Support Vector Machine Techniques for Nonlinear Equalization. IEEE TRANS ON SIGNAL PROCESSING, VOL. 48, NO. 11, NOVEMBER 2000, 3217-3226
    
    [100] Daniel J. Sebald, James A. Bucklew. Support Vector Machines and the Multiple Hypothesis Test Problem. IEEE TRANS ON SIGNAL PROCESSING, VOL. 49, NO. 11, NOVEMBER 2001,2865-2872
    
    [101] Jiaqi Wang, Chengqi Zhang. Support Vector Machines Based on Set Covering. Proceedings of the 2nd International Conference on Information Technology for Application (ICITA 2004), 181-184
    
    [102] Sungmoon Cheong, Sang Hoon Oh, Soo-Young Lee. Support Vector Machines with Binary Tree Architecture for Multi-Class Classification. Neural Information Processing - Letters and Reviews Vol. 2, No. 3, March 2004, 47-51
    
    [103] Matilde Sanchez-Fernandez, Mario de-Prado-Cumplido, Jeronimo Arenas-Garcia, Fernando Perez-Cruz. SVM Multiregression for Nonlinear Channel Estimation in Multiple-Input Multiple-Output Systems. IEEE TRANS ON SIGNAL PROCESSING, VOL. 52, NO. 8, AUGUST 2004, 2298-2307
    [104] Rik Fransens, Jan De Prins, Luc Van Gool. SVM-based Nonparametric Discriminant Analysis, An Application to Face Detection. Proceedings of the Ninth IEEE International Conference on Computer Vision (ICCV'03)
    [105] Chih-Chung Chang, Chih-Wei Hsu, Chih-Jen Lin. The Analysis of Decomposition Methods for Support Vector Machines. IEEE TRANS ON NEURAL NETWORKS, VOL. 11, NO. 4, JULY 2000, 1003-1008
    [106] James Tin-Yau Kwok. The Evidence Framework Applied to Support Vector Machines. IEEE TRANS ON NEURAL NETWORKS, VOL. 11, NO. 5, SEPTEMBER 2000, 1162-1173
    [107] Malte Kuss, Thore Graepel. The Geometry Of Kernel Canonical Correlation Analysis. Max-Planck-Institut for biologische Kybemetik, Technical Report No. 108, May 2003
    [108] DENNIS DECOSTE, BERNHARD SCH oLKOPF. Training Invariant Support Vector Machines. Machine Learning, 46, 2002, 161-190
    [109] Thorsten Joachims. Transductive Learning via Spectral Graph Partitioning. Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), Washington DC, 2003
    [110] Koby Crammer, Yoram Singer. Ultraconservative Online Algorithms for Multiclass Problems. Journal of Machine Learning Research 3 (2003), 951-991
    [111] Tao Li, Shenghuo Zhu, Mitsunori Ogihara. Using Discriminant Analysis for Multi-class Classification. Proceedings of the Third IEEE International Conference on Data Mining (ICDM'03)
    [112] Isabelle Guyon, John Makhoul, Richard Schwartz, Vladimir Vapnik. What Size Test Set Gives Good Error Rate Estimates? IEEE TRANS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 20, NO. 1, JANUARY 1998, 52-64
    [113] Eric Mjolsness, Dennis DeCoste. Machine Learning for Science: State of the Art and Future Prospects. Sicense, Vol. 293, Sept. 2001, pp. 2051-2055
    [114] Tom M. Mitchell. Machine Learning, McGraw Hill, 1997
    [115] 边肇祺,张学工等著.模式识别.清华大学出版社,1988
    [116] 卢增祥,李衍达.交互SVM学习算法及其在文本信息过滤中的应用.清华大学学报,1999
    [117] Friess T., Cristianimi N., Camplell,C. The Kemel Adatron Algorithm: A Fast And Simple Learning Procedure For Support Vector Machines. In Proceeding of 15th Intl. Conf. Machine Learning, Morgan Kaufrnan Publishers, 1998
    [118] Mangasafian O. L, Musicant D. R. Successive Overrelaxation For Support Vector Machines. IEEE TRANS ON NET WORKS, 1999, 10(5), 1032-1037
    [119] Scholkopf B., J. C. Platt, J. Shawe Taylor, J. Smola, R. C. Williamson. Estimating The Support of A High Dimension Distribution. Neural Computation, 2001, 13(7), 1443-1471
    [120] Chang Chih-Chung, Lin Chih-Jen. Training v-Support Vector Classifiers: Theory And Algorithms. Neural Computation, 2001, 13(9), 2119-2147
    [121] Lee T. J., Mangasarian O.. RSVM: Reduced Support Vector Machines. In Proceeding of The First SIAM International Conference On Data Mining, 2001
    [122] Lin Kuan-Ming, Lin Chih-Jen. A Study On Reduced Support Vector Machines. IEEE TRANS ON NET WORKS, 2001, 12(6), 1288-1298
    [123] Hong-Gunn Chew, David J. Crisp, Robert E. Bogner, Cheng-Chew Lin. Target Detection In Radar Imagery Using Support Vector Machines With Training Size Biasing. In Proceeding Of 6th International ConferenceOn Control, Automation, Robotics And Vision, Singapore, 2000
    [124] Hong-Gunn Chew, Robert E. Bogner, Cheng-Chew Lin. Dual v-Support Vector Machine With Error Rate And Training Size Biasing. Proceeding Of 26th IEEE ICASSP, Salt Lake City, USA, 2001, 1269-1272
    [125] Lin Chun-Fu, Wang Sheng-De. Fuzzy Support Vector Machines. IEEE TRANS ON NET WORKS, 2002, 13(2), 464-471
    [126] Cortes C., Vapnik V. Support Vector Networks. Machine Learning, Vol. 20, 1995, 273-297
    [127] Osuna E., Freund R., Cirosi F. Improved Training Algorithm For Support Vector Machines. In 7th IEEE Workshop On Neural Networks For Signal Processing, NNSP'97, IEEE, 1997, 276-285
    [128] Joachims T. Making Large-Scale SVM Learning Practical. Advances In Kernel Methods-Support Vector Learning, Scholkopf B., MIT Press, 1999
    [129] Syed A N etc. Incremental Learning With Support Vector Machines. In IJCAI99 Workshop On Support Vector Machines, Stockholm, Sweden 1999
    [130] Mitra P., Murthy C. A., Pal S. K. Data Condensation In Large Databases By Incremental Learning With Support Vector Machines. In Proceeding Of ICPR2000, 2000, 2, 712-715
    [131] Platt J., Cristianini N., Shawe-TaylorJ. LargeMargin DAGs for Multiclass Classification, Advances in Neural Information Processing Systems 12, MIT Press, 2000: 547-553
    [132] Dietterich T. G., Bakiri G. Solving Multi-Class Learning Problems Via Error-Correcting Output Codes. Journal Of Artificial Intelligence Research, 1995, 2, 263-286
    [133] Rakhlin A., Yeo G., Poggio T. Extra-Label Information Experiments With View-Based Classification. In Proceeding Of the 6th International Conference On Knowledge-Based Intelligent Information & Engineering Systems (KES'2002), Italy, 9, 2002, 16-18
    [134] T. S. Jaakkola, M. Diekhans, D. Haussler. A Discriminative Framework For Detecting Remote Protein Homologies. J. Comp. Biol., 2000, 7, 95-114
    [135] N. Smith, M. Gales. Speech Recognition Using SVMs. In Advances In Neural Information Processing Systems, 14, MIT Press, 2002
    [136] Ayat N E, Cheriet M, Remaki L etc. KOMD-A New Support Vector Machine Kenerl With Moderate Decreasing For Pattern Recognition, Application To Digit .Image Recognition. Proceeding Of 6th Int Conf On Document Analysis And Recognition. Seattle, USA, IEEE, 2001, 1215-1221
    [137] Amari S-I., Wu S. An Information-Geometrical Method For Improving The Performance Of Support Vector Machine Classifiers. Proceeding Of Artificial Neural Networks, 1999, 85-90
    [138] Chapelle O, Vapnik V, Bacsquest etc. Choosing Multiple Parameters For Support Vector Machines. Machine Learning, 2002, 46(1), 131-159
    [139] Baesens B, Viaene S, Gestel T V etc. An Emperical Assessment For Kernel Type Performance For Least Squares Support Vector Machine Classifiers. Proceeding Of 4th Int Conf On Knowledge-Based Intelligent Engineering Systems And Allied Technologies, Brighton, U-K, IEEE, 2000, 1, 313-316
    [140] Tax D., Duin R. Data Domain Description By Support Vectors. In Proceeding Of ESANN99, ed. M Verleysen, D. Facto Press, Brussels, Baldonado, M., Chang, 1999, 251-256
    [141] Oren M., Papageorgiou C. and Sinha P. et al..Pedestrian Detection Using Wavelet Templates. Proceedings of CVPR'97, 1997, Puerto Rico
    [142] Osuna E., Freund R. and Girosi F.. Training Support Vector Machines: An Application To Face Detection. Proceedings of CVPR'97, 1997, Puerto Rico
    [143] Hearst M. A., Scholkopf B. and Dumais Setal.. Trends.and controversies support vector machines. IEEE Intelligent Systems, 1998, 13 (4), 18-28
    [144] Reyna R. A., Hernandez N., Esteve D. et al.. Segmenting images with support vector machines. Proceedings 2000 International Conference on Image Processing, 2000, 1(1), 820 -823
    [145] Keren D., Osadchy M. and Gotsman C.. Antifaces: A novel, fast method for image detection. IEEE Transactions on Pattem Analysis and Machine Intelligence, 2001, 23 (7), 747-761
    [146] Vailaya A., Zhang H., Zhang HongJiang et al..Automatic image orientation detection. IEEE Transactions on Image Processing, 2002, 11(7), 746-755)
    [147] Tian Q., Hong P. and Huang T.S..Update relevant image weights for content-based image retrieval using support vector machines: Proceedings of 2000 IEEE International Conference on Multi media and Expo, 2000, 2(2), 1199-1202
    [148] Guo Guo-Dong, Jain A. K., Ma Wei-Ying et al. .Learning similarity measure for natural image retrieval with relevance feedback. IEEE Transactions on Neural Networks, 2002, 13 (4), 811-820
    [149] Brown M., Lewis H.G. and Gunn S.R..Linear spectral mixture models and support vector machines for remote sensing. IEEE Transactions on Geoscience and Remote Sensing, 2000, 38 (5), 2346-2360
    [150] Wan V. and Campbell W.M..Support vector machines for speaker verification and identification. Proceedings of the 2000 IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing, 2000, 2 (2), 775-784
    [151] Xin Dong and Wi Zhaohui.. Speaker recognition using continuous density support vector machines. Electronics Letters, 2001, 37 (17-16), 1099-1101
    [152] Gordan, M., Kotropoulos C. and Pitas I..Application of support vector machines classifiers to visual speech recognition. Proceedings. 2002 International Conference on Image Processing, 2002, 3, 129 -132
    [153] Ahmad A. R., Khalid M. and Yusof R..Kernel methods and support vector machines for handwriting recognition. SCORED 2002. Student Conference on Research and Development, 2002, 309-312
    [154] Bahlmarm C., Haasdonk B. and Burkhardt H..On-line handwriting recognition with support vector machines - a kernel approach. Proceedings of Eighth International Workshop on Frontiers in Handwriting Recognition, 2002, 49-54
    [155] Lu Chunyu, Yan Pingfan, Zhang Changshui et al. Face recognition using support vector machine. Proceedings of ICNNB'98, Beijing, 1998, 652-655
    [156] Kim K. I. Kim J. and Jung K.. Recognition of facial images using support vector machine. Proceedings of the 11th IEEE Signal Processing Workshop on statistical Signal Processing,, Singapore, 2001, 468-471
    [157] Xi Dihua and Lee Seong-Whan.. Face detection and facial feature extraction using support vector machines.. Proceedings of 16th International Conference on Pattern Recognition, 2002, 4 (4), 209-212
    [158] Pontil M. and Verri A..Support vector machines for 3D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20 (6), 637-646
    [159] Roobaert D. and Van Hulle M.M..View-based 3D object recognition with support vector machines. Proceedings of the 1999 IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing Ⅸ, 1999, 77-84
    [160] Schwenker F., Kestler H.A. and Simon S.. 3D object recognition for autonomous mobile robots utilizing support vector classifiers. Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation, 2001, 344-349
    [161] Brown M., Grundy W., Lin D. et al..Support Vector Machine Classification of Microarray Gene Expression Data. Technical report UCSC-CRL-99-09, University of California, Santa Cruz
    [162] Valentini and Giorgio..Gene expression data analysis of human lymphoma using support vector machines and output coding ensembles Artificial Intelligence in Medicine, 2002, 26 (3), 281-304
    [163] Cai Yu-Dong, Liu Xiao-Jun, Xu Xue-biao et al.. Prediction of protein structural classes by support vector machines. Computers and Chemistry, 2002, 26 (3), 293-296
    [164] Liu Weiqiang, Shen Peihua, Qu Yingge et al.. Fast algorithm of support vector machines in lung cancer diagnosis. Proceedings of International Workshop onMedical Imaging and Augmented Reality, 2001, 188-192, Hong Kong, China
    [165] Bhanu P. K. N., Ramakrishnan A.G., Suresh S. et al..Fetal lung maturity analysis using ultrasound image features. IEEE Transactions on Information Technology in Biomedicine, March 2002, 6 (1), 38-45
    [166] Rychetsky M., Ortmann S. and Glesner M..Support Vector Approaches for Engine Knock Detection. International Joint Conference on Neural Networks (IJCNN 99), 1999, Washington, USA
    [167] de Kruif B.J. and de Vries T.J.A..On using a support vector machine in learning feed-forward control. Proceedings of IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 2001, 1 (1), 272-277
    [168] Suykens J.A.K., Vandewalle J. and De Moor B..Optimal control by least squres support vector machine. Neural Network, 2001, 14, 23-35
    [169] Suykens, J.A.K. and Vandewalle, J..Recurrent least squares support vector machines. IEEE Transactions on Circuits and Systems, 2000, 47(7), 1109-1114
    [170] Chen S., Samingan A.K. and Hano L. .Support vector machine multi-user receiver for DS-CDMA Singnals in multipath Channels. IEEE Trasaction on nueral network, 2001, 12 (3)
    [171] Francis E.H.T. and Cao Lijuan .Application of support vector machines in financial time series forecasting. Omega,2001, 29, 309-317
    [172] Hong S. J. and Weiss S. M..Advance in predictive models for daya mining. Pattern recognition letter, 2001, 22, 55-61
    [173] Drucker H., Shahrary B. and David C. G.. Support vector machine: relevance feedback and information retrieval. Information processing and management, 2002, 38, 305-323
    [174] Huang-Chi Chen, Yih-Lon Lin, Yeong-Jen Sun, Jer-Guang Hsieh. Modified Rosenblatt's Perceptron Algorithm And Novikoffs Theorem. IEEE ICIT'02, Bangkok, THAILAND, 2002, 1282-1284

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700