Steel rail tread defect recognition method based on combination of gray image and depth image

Abstract

The invention discloses a steel rail tread defect recognition method based on combination of a gray image and a depth image. The method comprises the steps of establishing a steel rail tread image data set by utilizing a registered gray image and depth image pair of a steel rail tread, dividing the data set into a training sample set and a test sample set, and preprocessing the images of the dataset; performing defect recognition by adopting a special convolutional neural network structure, wherein a front end of the network is provided with two branch structures, which can extract features from the gray image and the depth image of the steel rail tread respectively; fusing feature information of the gray image and the depth image through feature graph connection, and then outputting preliminary prediction results by adopting a prediction module; and finally, screening the preliminary defect prediction results by adopting a non-maximum suppression method to obtain a final steel rail defect recognition result. The method combines two-dimensional and three-dimensional features of the steel rail tread at the same time, has the capability of distinguishing real defects and pseudo-defects, can reduce the misjudgment rate and the missing detection rate, and is especially suitable for defect recognition in a complex environment.

Description

technical field [0001] The invention belongs to the technical field of pattern recognition and information processing, and relates to target detection technology, in particular to a rail tread defect recognition method based on the combination of grayscale images and depth images. Background technique [0002] Rail tread defect recognition refers to the process of locating the defect location and determining the defect type in the rail tread image. It is a difficult point in the application of computer vision technology in the industrial field, and it is an application technology of image-based target detection. Rail tread defect identification can be applied not only to the monitoring of the main railway line, but also to the detection of the rail production line. The difficulty in identifying rail tread defects lies in: affected by different factors such as light, water stains, and oil stains, the appearance of rail tread defects in the image is complex; some authentic an...

AI Technical Summary

Problems solved by technology

Relying entirely on 3D data to realize recognition not only has the disadvantages of large amount of 3D data and slow recognition speed, but also is prone to recognition errors

Images