Abstract: To achieve efficient collection, secure storage, quality control and safe sharing of massive, multi-source and heterogeneous railway infrastructure inspection data is an important problem that needs to be solved urgently. Combining with the characteristics of the railway infrastructure inspection business, this paper put forward the construction objectives of asset management system for railway infrastructure inspection data, studied and designed the system architecture, and expounds in detail the four management process areas in the system architecture, described the four management process areas in the architecture in detail, which provided support for the implementation of the asset-based management of the whole life cycle of the railway comprehensive inspection data "collection - transmission - storage - governance - sharing".