Abstract: This article presented an automatic monitoring and alarming system for railway fallen rocks based on radar and video analysis integrated alarming evaluation. The system analyzed the plane radar scan data above 70mm in orbit in real-time, combined with target recognition, intrusion detection, retention detection and other video analysis technology, comprehensively analyzed the obstacles in the monitoring area, sent warning and alarming information timely and accurately, and started the emergency disposal plan. So it could avoid the impact of traffic safety caused by line obstruction.