节点文献
基于抽样的贝叶斯网络推理算法研究
The Research on Inference Algorithm for Bayesian Networks Based on Sampling
【作者】 杨峰;
【导师】 王浩;
【作者基本信息】 合肥工业大学 , 计算机应用技术, 2008, 硕士
【摘要】 贝叶斯网络提供了一套强有力的图形工具来表达基于概率的领域知识,是对人工智能领域中不确定性问题进行表示和处理的一种重要工具,已被成功应用于故障诊断、数据挖掘和医疗诊断等领域。动态贝叶斯网络是贝叶斯网络在时间因素上的扩展,是对人工智能领域中动态不确定性问题进行表示和处理的一种重要工具。本文在对贝叶斯网络进行全面概述的基础上,对贝叶斯网络和动态贝叶斯网络的近似推理进行了研究。全文的主要内容如下:(1)贝叶斯网络的概述。概述了贝叶斯网络的起源与发展,详细介绍了贝叶斯网络模型、贝叶斯网络的构建过程、贝叶斯网络的类型以及贝叶斯网络的应用,并在此基础上,对动态贝叶斯网络进行了概述;概述了贝叶斯网络的主要研究内容,并对贝叶斯网络和动态贝叶斯网络的推理算法进行了重点介绍。(2)在贝叶斯网络近似推理方面,针对贝叶斯网络的马尔可夫链蒙特卡洛(Markov Chain Monte Carlo,MCMC)推理存在的问题,本文以MCMC推理算法中具有代表性的Gibbs抽样为基本框架,提出一种贝叶斯网络的并行MCMC(Parallel MCMC,PMCMC)推理方法,在生成马尔可夫链的组成序列时,通过增加对贝叶斯网络中每个结点的抽样频率,即加大样本数来提高其推理精度,并在消息传递接口MPI的支持下,利用主从式并行机制来实现其推理过程,以保证推理的时间性能。在3个不同贝叶斯网络即Asia、Mildew和Alarm网上的推理实验结果表明,PMCMC在提高推理精度的同时有效保证了推理的时间性能。(3)在动态贝叶斯网络近似推理方面,针对动态贝叶斯网络的粒子滤波推理存在的问题,本文将离散粒子群优化技术引入到传统粒子滤波推理中,提出一种新的粒子滤波算法—进化粒子滤波(Evolutionary Particle Filtering,EPF)。在进化粒子滤波中,利用离散粒子群优化技术的迭代寻优能力重新分配粒子,使粒子的表示更加接近真实后验概率密度,以提高粒子滤波推理的精度性能。在2个不同动态贝叶斯网络上的概率推理实验结果表明,与传统的粒子滤波推理算法相比,EPF利用较少的粒子就可以取得较好的推理精度。
【Abstract】 Bayesian network provides a powerful graph tool to express domain knowledge based on probability. It has becomes an important methodology for representing and computing uncertain problem of stochastic processes in the field of artificial intelligence, and it has been successfully applied to fault diagnosis, data mining, medical diagnosis, and other fields. Dynamic Bayesian network is a Bayesian network with the expansion on the factor of time, it provides a powerful tool to represent and deal with dynamic uncertain problem of stochastic processes in the field of artificial intelligence. Based on the comprehensive overview of Bayesian network, this thesis focuses on the research of approximate inference algorithm for Bayesian network and dynamic Bayesian network. The main contents of this thesis are as follows:(1) This thesis makes a survey about the research on Bayesian network, including the origin, development, the model, the construction process, the type and the application of Bayesian network. On basis of this, dynamic Bayesian network is introduced. And, the main research contents of Bayesian network are summarized. Moreover, the inference algorithms for Bayesian network and dynamic Bayesian network are introduced in detail.(2) In the approximate inference of Bayesian network, to deal with the existing problems of Markov Chain Monte Carlo (MCMC) inference algorithm, taking Gibbs sampling as an example, a parallel MCMC (PMCMC) inference algorithm for Bayesian network is proposed. To improve the accuracy, larger samples are used in PMCMC when generating the sequence of Markov chain. Moreover, to guarantee the inference speed, the algorithm has been implemented using the Master-Slave parallel programming model with the support of MPI. The experiment results on three different Bayesian networks show that PMCMC can achieve higher accuracy without the loss of time performance.(3) In the approximate inference of dynamic Bayesian network, to improve the performance of particle filtering (PF) inference algorithm, discrete particle swarm optimization (DPSO) technique is introduced to form a new filter called the evolutionary particle filter (EPF), in which the iterative search and optimization procedure of DPSO is used to redistribute particles closer to the true posterior density. The experimental results on two different dynamic Bayesian networks show that EPF can achieve better accuracy with fewer particles.
【Key words】 Bayesian Network; Dynamic Bayesian Network; Approximate Inference; Markov Chain Monte Carlo; Particle Filtering; Particle Swarm Optimization;
- 【网络出版投稿人】 合肥工业大学 【网络出版年期】2008年 11期
- 【分类号】TP183
- 【被引频次】8
- 【下载频次】663