节点文献

基于模糊熵的特征选择方法的研究与实现

Research and Implementation of Fuzzy Entropy-based Feature Selection Method

【作者】 李想

【导师】 林和平;

【作者基本信息】 东北师范大学 , 计算机软件与理论, 2010, 硕士

【摘要】 特征选择在模式分类过程中发挥着重要作用,选择的特征正确与否直接关系到分类结果的正确率,因此特征选择方法直接影响着系统的性能和质量。但是目前的多数特征选择方法都存在容易陷入局部最优的问题,为了能够快速准确的找到最小特征子集从而更好的实现分类,本文对特征选择方法进行了大胆的探索和尝试。蚁群优化算法作为一种群集智能算法,具有群集智能算法能够解决大多数全局优化算法的优点,蚁群优化算法是一种求解组合优化问题的新型通用启发式方法,蚁群优化算法具有正反馈、分布式计算和自组织性的特点,它是一种贪婪启发式搜索方法。而在实际应用中我们发现蚁群优化算法搜索时间较长,所以选择正确有效的信息素和约束条件变得十分重要。蚁群优化算法可以分为两个基本阶段:适应阶段和协作阶段。在适应阶段,各个候选解根据所积累的信息不断地调整自身结构。而在协作阶段,各个候选解之间不断进行信息交流,从而产生性能更好的解。熵描述了一个概率分布的不确定性程度。将熵概念移植到模糊集理论,可以得到模糊熵。模糊熵描述了一个模糊集的模糊性程度。一个模糊集合越模糊,它的模糊熵就越大,反之亦然。模糊熵描述的是概率分布的不确定程度,一个集合的不确定性越大,它的分布越均匀,信息量也就越大。在本文中,模糊熵作为信息素应用于蚁群优化算法中,能够帮助蚁群快速准确的找到重要特征子集。首先将整个数据集作为蚁群优化算法的输入,再随机选择一组特征作为初始特征子集,然后让蚁群按照规则运动,改变各个特征的信息素,最后获得目标特征子集。

【Abstract】 Feature selection process plays an important role in pattern classification, whether or not the correct choice of features directly related to the classification accuracy rate, so feature selection method is a direct impact on system performance and quality. However, the current existence of the majority of feature selection methods are easily trapped into local optimization problems, in order to be able to quickly and accurately find the smallest feature subset in order to better achieve the purpose of classification, feature selection methods is explored and tried bold in this paper.Ant colony optimization algorithm, as a swarm intelligence algorithm, with a swarm intelligence algorithm can resolve most of the advantages of global optimization algorithms. Ant colony optimization algorithm is a combinatorial optimization problem solving the new common heuristic method, ant colony optimization algorithm with positive feedback, distributed computing and self-organizational characteristics; it is a greedy heuristic search method. In practical applications, we found that ant colony optimization algorithm for the shortcomings of a longer search time, so choose the correct and effective pheromone and constraints become important. Ant colony optimization algorithm can be divided into two basic stages: stage adaptation stage and collaboration. In the adaptation phase, all candidate solutions according to the information accumulated by constantly adjusting its structure. In the collaboration phase, each candidate solution in the continuous exchange of information, resulting in better performance of the solution.Entropy of a probability distribution describing the degree of uncertainty. Transplanted to the entropy concept of fuzzy sets theory, can be fuzzy entropy. Fuzzy entropy describes a degree of ambiguity of fuzzy sets. A fuzzy set of the vaguer, and its fuzzy entropy, the greater and vice versa. Fuzzy entropy describes the probability distribution of the degree of uncertainty, the greater the uncertainty of a collection, its distribution more uniform, the greater the amount of information. In this article, fuzzy entropy as a pheromone used in ant colony optimization algorithm, the ant colony quickly and accurately to help find important feature subset. First, the entire data set as an ant colony optimization algorithm for the input, and then randomly select a set of features as the initial feature subset, and then let the ant colony movement in accordance with the rules to change the various characteristics of pheromones, finally won the goal of feature subset.

节点文献中: 

本文链接的文献网络图示:

本文的引文网络