【作者】 谢黎明；

【导师】 冯丹；

【作者基本信息】 华中科技大学 ， 计算机系统结构， 2007， 硕士

【摘要】 目前,在超级计算领域,对高I/O吞吐率、高并行性和高扩展性的存储系统要求日益迫切,而传统的存储系统已经难以满足应用需求。实际的需求推动着存储系统不断向前发展,一种新兴的存储模式,对象存储系统应运而生。对象存储系统中文件系统是分布式文件系统。与传统分布式文件系统不同的是,对象存储将数据管理功能下移到智能化的对象存储设备上。对象存储设备负责管理磁盘空间,是对象存储系统中数据的载体,也是存储系统管理的核心。单个对象存储设备性能的提升直接影响对象存储系统的性能。可以从硬件和软件两个方面改善其性能。硬件方面主要针对网络存储的特征,设计I/O吞吐率高、低功耗和可扩展性好的嵌入式对象存储设备控制器,它采用Xscale微架构处理器和交换式架构实现。交换式架构支持任意接口到其他接口的并行事务,可以解决传统I/O总线瓶颈,实现并行I/O。软件方面主要是在对象设备端开发基于扩展哈希的对象文件系统XOBFS(eXtensible hashing Object-based Storage File System),实现对象存储系统存储资源管理。在XOBFS中,磁盘空间被划分成多个区域单元,区域中定长块分配策略与位图管理空闲块方式结合,使得系统在长期运行中不会产生外部碎片,性能不会退化;对象属性用扩展哈希管理,在哈希桶中采用相同对象属性相邻存放策略。属性管理的实现,为更好地组织与管理数据,以及改善数据共享做好准备。最后通过合成Trace对XOBFS进行仿真测试,测试结果表明XOBFS的I/O吞吐率比传统文件系统高,且不会随时间增长而老化。XOBFS为对象存储设备端提供了一种有效的数据管理方法。更多还原

【Abstract】 With the increasing demand of high data throughput, highly parallel data transfer and highly scalable storage system, especially in the field of super computing, the traditional storage system cannot meet the requirements any longer. With the driven needs of applications, storage system must have changes. A new storage model, Object-based Storage System, OBS for short, comes up. The file system used in the OBS, is a distributed file system. The storage management model down to the intelligent devices, which is different from the traditional one. The Object-based Storage Device, OSD for short, which is the core part of the OBS, carries the data in the OBS and also takes charge of the management of space in the physical disc.The performance of the single OSD can be improved via two methods. The first one is to design a new Object-based Storage Device Controller, OSC for short. OSC is based on the switch fabric architecture. And two CPUs with Xscale architecture are included in OSC. The switch fabric breaks through the bottle-neck of I/O system, and implements the parallel I/O access in the hardware level. The second one is the management of disc space. XOBFS, which stands for eXtensible hashing Object-based Storage File System, uses the fixed-block allocation policy and manages the free space with the bitmap method. And XOBFS organizes the metadata in extensible hashing structure. All of this cannot make fragmentation after long term running. The performance does not degenerate as the file system ages.By collecting blocks of same size into regions, XOBFS can avoid the system fragmentation as the system ages. However, on the worst condition, there would be a waste of about 10 percent of total disc space. For organizing and managing data effectively, the object attributes are included in XOBFS. Compared with the traditional file systems, the throughput of XOBFS is the best one. XOBFS provides an effective method for storage management in OSD.更多还原