Abstract: Aiming at the problem that the existing support vibration displacement measurement algorithm, which is based on surface texture feature tracking of structures, easily disturbed by lighting, background clutter, motion blur and other factors, this paper proposed an accurate measurement method for railway bridge support vibration displacement based on line feature tracking. In order to improve the calculation efficiency of the support displacement, the paper obtained the target of interest by using Otsu method and continuum analysis method, and determined the line-tracking area based on the target of interest, enhanced the calculation efficiency of support displacement; used a linear robust detection operator to quickly extract the coordinate changes of the line-tracking area during the bridge support vibration; used the fusion filter to post-process the bridge support vibration displacement data and finally implement the accurate calculation of the bridge support vibration displacement. The measurement method was applied to the actual bridge support vibration displacement monitoring system. The application results show that the method achieves good results in measurement accuracy and meets the needs of bridge structure health monitoring.