Abstract: In order to improve the intelligent level of high-speed train, the intelligent video analysis system for high-speed train is built, which is mainly composed of on-board camera, video monitoring server, intelligent analysis host and can exchange information with other on-board systems and equipment through the carriage controller. The intelligent video analysis models are built based on deep learning algorithm, and the functions of sensitive personnel identification, passenger congestion detection, baggage detection, key location monitoring and driver fatigue monitoring are realized. Once abnormal events are detected and identified, the alarm information can be automatically displayed on the display terminals or played by the broadcast device in the passenger information system.