节点文献

广域网存储服务中数据传输中间件的研究与实现

The Research and Implementation of Data Transfer Middleware

【作者】 陈小庆

【导师】 冯丹;

【作者基本信息】 华中科技大学 , 计算机系统结构, 2007, 硕士

【摘要】 随着网络技术的迅速发展,通过网络进行传输的信息量正呈指数级增长,网络存储系统的研究已经成为计算机领域的一个研究热点。下一代互联网时代的到来对网络存储提出了新的要求,那就是海量结点,超大容量,服务式存储,高可靠性,高可用性和高性能。广域网存储服务USTOR(Ubiquitous Storage)基于IPv6在广域网范围构建,支持PB级的总存储容量和至少256个分布式存储节点。系统分为存储管理、元数据和数据传输中间件三个部分。存储管理建立在存储管理主动规范协议之上,对各种异构的存储设备进行统一管理,并收集存储节点的设备和网络信息提交给元数据管理部分;相关信息被元数据模块处理成为全局视图的变量,交给上层的动态负载平衡模块,该模块协调各个存储节点之间的负载平衡和实现用户存储空间的分配与调度;数据传输中间件为用户提供存储服务,主要是数据管理和数据快速、安全的传输。作为USTOR的重要组成部分,数据传输中间件在开放、动态的IPv6网络环境下实现数据的快速存取和安全可靠的传输。数据传输中间件主要包括三个部分:数据传输协议,安全机制和移动Cache机制。数据传输协议实现了信息通信和数据传输;安全机制包括三方身份认证和安全传输机制,前者是对用户的身份进行检验,而后者是为了防止重要数据在传输过程中被窃取和篡改而设置的安全措施;移动Cache机制建立在协议之上,是对传输性能的优化,可以改善传输中间件的传输服务质量。最后在实验室搭建的广域网存储服务USTOR平台上进行了测试。测试结果表明,数据传输中间件和传统的传输协议(如FTP)相比,在传输性能上有着一定的优势,使用移动Cache机制进行传输优化后,传输性能得到很大提高,传输的安全性在安全机制的保障下得到进一步提高。

【Abstract】 Along with the rapid development of network tech, the information transferred by network is increasing at exponent level. The research on network storage system is becoming a new hotspot in computer architecture field. Also, the next generation of the Internet put forward the new requirement of network storage that is massive in node and capacity, storage service, high reliability, convenient usability and excellent performance.The Storage Service USTOR (Ubiquitous Storage) for the Next Generation Internet is set up in IPv6 WAN, which supports the total storage capacity of PB class, and supports at least 256 distributed nodes. The system is divided into such three parts as the storage management, metadata management and the data transfer middleware. The storage management component based on the SMI-S (Storage Management Interface Specification) protocol is responsible for the unifying management of various storage equipments, and collecting from each storage note of the related data to the metadata management component. Related data is proceed by the metadata management component and then handed to the upper dynamic load-balancing component, which will moderate the load circumstances among storage nodes, and then hand over related data in user storage space to the data transfer middleware. The data transfer middleware provides storage services to customers, mainly for data management and fast, convenient and safe data delivery.As an important part of the USTOR, data transfer middleware, in the open and dynamic IPv6 environment, implements rapid and long-range data access, meanwhile it transfers data with great safety and reliability, and assures the storage service. The storage middleware consists of three parts: the transfer protocol module, the mobile cache module and the security module. The transfer protocol module implements file management as well as file reading and writing. The security module is made up of three-side authentication and secure data transfer mechanism, among which the former one is to check the identity of users while the later one is a security method to protect the important data from being stolen or modified when it is on its way. The mobile cache module, which is the representation of high-quality service and timely, is built on this protocol, and it is an optimization of the performance of data transfer.The testing results of the storage system platform built in the lab shows that the data transfer middleware has some advantage over traditional transfer protocol (e.g. FTP) on the transfer rate. With the optimization of cache, the performance of data transfer has been greatly enhanced and its security is ensured by the security module.

  • 【分类号】TP311.52;TP333
  • 【被引频次】1
  • 【下载频次】98
  • 攻读期成果
节点文献中: