• 查询稿件
  • 获取最新论文
  • 知晓行业信息

基于Kettle的铁路客运营销数据交换平台的设计与实现

Railway passenger transport marketing data exchange platform based on Kettle

  • 摘要: 随着铁路客票系统的不断发展和业务需求的不断增加,海量客运营销数据的多源、异构特征越发明显,跨节点跨网段数据交换越发频繁。基于开源ETL数据分析工具Kettle构建营销数据ETL过程模型,设计高可配数据模型管理、定制触发规则、根据调度周期自主运行作业的数据交换核心模块。采用面向接口服务的架构体系,融合分布式技术,开发客运营销数据交换平台,对客运营销数据进行抽取、转换、加载,实现数据的快速集成与交换。设计了基于Web的任务配置、节点管理和异常处理等功能,支持跨节点跨网段的数据交换作业以及分布式部署,能够及时进行异常作业预警和消息推送。由此,营销数据交换平台的使用极大地满足了当前铁路客运营销数据汇集、交换的需求,在充分合理利用现有数据资源、减轻数据维护工作量等方面发挥了重要作用。

     

    Abstract: With the continuous development of the railway passenger ticketing and reservation system and the increasing business demand, the multi-source and heterogeneous characteristics of the massive passenger transport marketing data become more and more obvious, and the cross node and cross network segment data exchange becomes more and more frequent.Based on Kettle, an open-source ETL data analysis tool, this article constructed the ETL process model of marketing data, and designed the core modules of data exchange, which were with high configurable data model management, customized trigger rules, and independently running jobs according to the scheduling cycle. The article used the architecture system of interface service oriented, integrated the distributed technology, developed the passenger marketing data exchange platform, extracted, transformed and loaded the passenger marketing data, implemented the rapid integration and exchange of data.In addition, the article designed the functions of task configuration, node management and exception handling based on Web, and supported data exchange jobs and distributed deployment across nodes and network segments, could carry out abnormal operation warning and message push in time.The use of the marketing data exchange platform greatly meets the demand of the current railway passenger transport marketing data collection and exchange, and plays an important role in making full use of the existing data resources and reducing the workload of data maintenance.

     

/

返回文章
返回