节点文献

工行山东分行综合数据集成平台的分析与设计

The Analyze and Design of the Branch Data Integration

【作者】 宋华峰

【导师】 王新军;

【作者基本信息】 山东大学 , 软件工程, 2008, 硕士

【摘要】 随着工商银行数据大集中的逐步深入,各种业务不断进行整合,各种系统的数据逐步集中到了总行,形成了上海、北京两大数据中心,各分行基本上不再保留任何主机的数据。在这种模式下,各行对于经营管理分析基本上依赖于报表返传数据以及总行开发的CS2002等系统。这种模式在数据大集中初期并没有任何问题,但是随着业务的发展和公司的上市,工商银行开始了精细化运作,对客户评介、员工考核越来越细致,经营决策需要考虑的因素越来越多,对数据的要求越来越高,简单的利用总行的CS2002等系统以及每天返传的报表数据进行统计分析无论是从数据质量的要求还是数据范围的要求以及数据的时效性要求等方面都远远不够,急需建立一套完整的数据平台为管理决策、客户评价、员工考核提供数据支持。本文以员工综合业绩评价、客户评价两个具体的需求为突破口,对员工业绩评价、客户评价所需要的数据需求进行了详细的分析,确定了数据的来源,描述了系统的用例图、顺序图,设计了系统的网络架构、体系架构和逻辑架构,对数据库的表进行了ER表示,参照以往系统的开发经验和工行总行的要求选择了搭建平台所需要的软硬件环境。对Oracle数据库的表空间技术、表和索引分区机制、外部表技术进行了详细的研究,通过对各种ETL工具的比较,设计了一套适合工行山东分行的数据抽取导入(ETL)方案,实现了数据从数据源到数据仓库的抽取、清洗和转换的过程,为综合数据集成平台建立了数据池。通过对Oracle数据库的参数进行优化,设计了符合要求的数据老化、数据备份策略。最后,建立了一个以SUSE Linux Enterprise 9为操作系统,ORACLE10G为后台数据库,使用WebSphere6.0作为应用服务器中间件的综合数据集成平台,实现对当前主机返传数据、国际卡业务数据、CM2002下载数据、PCM2003下载数据、网银下载数据、电话银行下载数据的加工、利用与存储,为工行山东分行的特色系统开发提供基础数据和开发环境,以满足我行目前客户评价、员工考核、经营数据分析的要求。

【Abstract】 With the gradual deepening of concentration in data of Industrial and Commercial Bank of China, continuous conformity of various businesses, all kinds of systems’ data are concentrating into headquarters gradually to form two data centers of Shanghai and Beijing, every branch generally can’t keep data of host computer any more. Under this pattern, business and management analysis of various banks basically relies on feedback data from report forms and CS2002 system developed by headquarters and so on. In the beginning of data concentration, this kind of pattern doesn’t exist any problems, but with the development of business and company listing, Industrial and Commercial Bank of China begins to particular operation, the assessment to employees and customers is becoming more and more specific, the business and decision-making need to consider more and more factors, with much higher requirements to data, simply applying CS2002 system developed by headquarters and feedback data from report forms everyday to analyze is not enough not only for requirements of data quality but also for the requirements of data degree as well as the time effective requirements of data, it is urgent to build up a suit of compete data platform to provide data support for management decision-making, customer assessment and employee examination.This paper starts from the two specific demands of employee integrated performance assessment and customer assessment, and specifically analyzes the data needed by employee integrated performance assessment and customer assessment, and determines the source of data, and describes the example picture of system, order picture, designs the network structure, system structure and logic structure of this system, and makes ER indication to the database forms, and setups the software and hardware environments required by selecting platform according to the previous development experiences and the requirements of Industrial and Commercial Bank of China headquarters. This paper makes specific study on form space technology, form, index sub area mechanism and outside form technology of Oracle data, designs a suit of ETL scheme suitable for Shandong branch of Industrial and Commercial Bank of China which realizes the process of taking out data, cleaning data and transfer data from data source to database which builds data pool for integrated data platform. It designs the data outdate and backup strategy meeting demands by parameter optimization to Oracle database.At last, it builds up a integrated data integration platform treating SUSE Linux Enterprise 9 as operation system, ORACLE10G as background database and WebSphere6.0 as application server middle components which can realize host computer returning data, international card business data, CM2002 downloading data, PCM2003 downloading data, electronic bank downloading data, the processing, application and storage of telephone bank downloading data, which develops basic data and development environment for the feature system development of Shandong branch of Industrial and Commercial Bank of China to meet the demands of current customer assessment, employee examination and business data analysis in our bank.

【关键词】 数据集成平台ETL分区外部表Oracle
【Key words】 The Data Integration platformETLPartitionExternal tableOracle
  • 【网络出版投稿人】 山东大学
  • 【网络出版年期】2009年 05期
  • 【分类号】TP311.52
  • 【下载频次】120
节点文献中: 

本文链接的文献网络图示:

本文的引文网络