【作者】 刘沛旻；

【导师】 李翔；

【作者基本信息】 上海交通大学 ， 电子与通信工程， 2007， 硕士

【摘要】 随着互联网的飞速发展,合法和非法的信息充斥其中,基于内容的网页过滤成为了安全领域的新焦点。网页内容过滤系统的技术很多,包括URL数据库名单过滤技术、关键词过滤、模式过滤技术等,尽管这些过滤技术在国外已经发展了几十年,并有了相当成熟的产品,但是由于汉语语言的特殊性,现有的网页内容过滤系统是否能够适合中文网页内容的过滤;何种网页过滤技术最适应当前飞速发展的互联网应用,都是我们希望进一步研究的课题。本文前两章介绍了目前网页过滤技术发展的背景,阐述了为什么网页过滤技术成为了目前安全领域的新焦点以及研究比较的必要性;我们并针对各种目前主流的网页过滤技术的工作原理、关键技术进行了详细讨论。在第三章和第四章,我们依据前面阐述的网页过滤技术的特点,构建了各种网页过滤技术比较研究的测试平台,对拟定的问题进行比较验证,并最终得出分析比较的结果。我们通过比较分析各种实际实验数据,总结出:1)最适合中国的网页过滤技术应该是以中文网页过滤技术为基础,并融合国外成熟的基于名单的过滤技术、关键词过滤技术的综合技术;2)网页过滤技术的应用并不是统一模式的,在不同的用户市场会有不同的需求,最佳的部署方式也会不同,我们在结论中还列举了网页过滤技术在不同应用环境中实现的最佳实践方式。最后,我们把在此次课题的调查研究中发现的一些新涌现的需求、问题列举出来,例如:对于网页病毒和其他网页威胁的应对需求、反过滤技术的出现,来为后人提供网页过滤技术研究的新方向,展望未来网页过滤系统的概貌。更多还原

【Abstract】 With the rapid development of Internet, in which is full of a great amount of legal and illegal information, the Web Filtering has already been a new focus in security field. There are a lot of Web Filtering techniques, including URL lists filtering, keyword filtering and multi keyword filtering etc. Although these filtering technology had several decades development history, and mature products are available, regard to unique specialty of Chinese language, can it support to filter Chinese web pages smoothly with particularity of Chinese language; can it adapt to the rapid development of various Internet applications, it is puzzles we want to make it clear.The first two chapters in this thesis introduced the background of web filtering technique, why web filtering become the new focus of network security field, and why we need to pay more attention to it; we also analyzed the functions and key points of various popular web filtering techniques in detail. In Chapter 2 and 3, we implemented different testing environments to test and verify the puzzles we mentioned early. We conclude: 1) the best web filtering technique in china is a sophisticated technique based on Chinese web content filtering technique, combined mature URL list filtering, keyword filtering techniques. 2) No uniform deployment methodology for web filtering, different market has different need, different environment need different implement method. We list the best practice in different market and different environment in this thesis. Finally, we illustrate new requirements and questions in our investigation, such as requirements for filtering malicious webpage, anti-filtering challenge. We prospect for the future of development of web filtering.更多还原