Abstract: The aim of TEDS was to detect the trouble of moving EMU images based on the matching between present image and previous one. However, the traditional TEDS was easily affected by some related issues such as speed, light and so on. This article proposed an algorithm to recognize the trouble of EMU image by adaptive fusion local and global matching. First, the image was aligned according to the carriage. And then the SIFT matching was adopted to accomplish the rough detection. Based on such detection, the template matching was further used to locate the trouble of EMU image. To reach the requirement of multilevel trouble alarm, we finally defined the trouble level according to the different components.The experimental result showed that the proposed algorithm could detect the trouble of moving EMU effectively.