System and method for image search through images of multi-task portal vehicles

Abstract

The invention relates to a system and a method for image search through images of multi-task portal vehicles. According to the method, a deep neural network is utilized to establish a multi-task positioning network and a multi-task feature extraction network; the positioning network is trained based on an improved edge box detection technology and cascaded loss functions; positioning and feature detection are performed on vehicles, annual inspection signs and lamps in portal vehicle images, and global features and local features are combined; a softmax loss function and a triad loss function are adopted for network training; and finally local feature vectors are subjected to weighting combination, and global feature vectors of the last full-connection layer of the neural network are utilized to serve as vehicle features for retrieval, wherein an improved k-means algorithm is adopted to find a K class in retrieval, and then an SVM is utilized to form a Hash function for Hamming coding.In this way, retrieval speed is increased, and storage space is saved.

Description

technical field [0001] The invention relates to the field of intelligent transportation, in particular to a system and method for searching images by images for multi-task bayonet vehicles. Background technique [0002] With the development of society, intelligent traffic monitoring in the field of intelligent transportation is a very important development direction at present. At present, a large number of electronic police and checkpoint systems have been deployed on urban roads in my country. These systems can capture high-definition pictures of vehicles in real time, and identify and analyze the license plate number, as well as some vehicle model information (such as vehicle size, color, etc.). However, in the currently used bayonet monitoring system, the license plate number recognition still has a misrecognition and missed recognition rate of about 10%. More importantly, it will not be possible to identify illegal vehicles with license plates or deliberately concealed...

AI Technical Summary

Problems solved by technology

[0005] "Deep Learning-Based Vehicle Vehicle Identification Model Construction Method and Vehicle Vehicle Identification Method", application number 201610962720.5, using deep learning for vehicle vehicle identification, which has not reached the level of fine-grained vehicle retrieval and is not accurate enough

Images