Abstract: Aiming at the locator defect detection of contact line inspection image, this paper proposed a detection integration algorithm based on image depth representation and line detection. This algorithm adopted selective search algorithm to obtain the possible alternative regions in image where locator may exist. The deep features of image were calculated by deeply convolutional neural network and local region of locator could be obtained by multi-task learning algorithm. Subsequently, by using Canny edge extraction and Hough line detection method, locator line could be exactly detected in local region. According to the practical application scene of contact line inspection image, this algorithm has been tested by several locator detection tasks at different scenes. The experiments proved that this algorithm could solve the detector defect detections problems effectively in complex environment.