节点文献

支持向量机的快速分类方法研究

A Study on Fast Classify Method for Support Vector Machines

【作者】 李广莉

【导师】 王熙照;

【作者基本信息】 河北大学 , 应用数学, 2008, 硕士

【摘要】 支持向量机是Vapnik等人提出的一类新型机器学习方法,它是基于统计学习理论,借助最优化方法来解决机器学习问题的新工具,支持向量机目前还存在许多局限性,研究有待进一步探索和完善。本文以统计学习理论(Statistic Learning Theory-SLT)和支持向量机(Support Vector Machine-SVM)为基础,开展了以下研究工作:首先,对统计学习理论和支持向量机分类器进行了全面的总结和概括。其次,总结了现有的几种有代表性的多类支持向量机方法,这些方法包括:一对多(one-against-all)、一对一(one-against-one)、有向无环图支持向量机(DAG-SVMs)、决策树分类和全局优化分类(MSVM);还介绍了两种模糊多类支持向量机方法。第三,总结了适合于求解大型问题的训练算法:选块算法(Chuncking),分解算法(Decomposing)和序列最小最优化算法(Sequential Minimal Optimization-SMO)等,这些都是专门针对支持向量机设计的快速算法。提出了一种改进的模糊多类支持向量机方法,它是在全局优化分类(MSVM)的基础上,引入模糊隶属函数;然后利用改进的序列最小最优化算法求解模糊多类支持向量机,实验结果显示运行时间减少了,方法是可行的和有效的。

【Abstract】 Support vector machine (SVM), which was proposed by Vapnik and some other scholars, is one of the standard tools for machine learning and data mining. It is an implementation of structure risk minimization principle in the statistical learning theory. Based on the statistical learning theory and optimization theory, SVM has been successfully applied to many fields. But, SVM, which still has some limitations, needs to be further explored and perfected. In this thesis, several issues are addressed, which are based on statistic learning theory (SLT) and support vector machine (SVM). The main work and results are outlined as follows:Firstly, the statistical learning theory and SVM are summarized and analyzed.Secondly, five major kinds of multicategory support vector machine methods are systematically summarized and analyzed. These multicategory classification methods include--One-against-All, One-against-One, Directed Acyclic Graph SVMs (DAG-SVMs), Decision-Tree-Based Multiclass Support Vector Machines and Multiclass Support Vector Machines. Two kinds of Fuzzy Support Vector Machines are analyzed.Thirdly, the training algorithms of SVM for large-scale training set are summarized and analyzed. These methods include-Chuncking, Decomposing and Sequential Minimal Optimization-SMO. An improved fuzzy multicategory support vector machines are presented. We extend to the Multiclass Support Vector Machines method, and with the fuzzy membership of data samples of a given class, to improve classification performance with high generalization capability. We used the improved Sequential Minimal Optimization to solve fuzzy multicategory support vector machine. The experimental results show that the computational load be reduced greatly and with high generalization capability.

  • 【网络出版投稿人】 河北大学
  • 【网络出版年期】2011年 S1期
节点文献中: 

本文链接的文献网络图示:

本文的引文网络