A gesture recognition method and system based on STT-LSTM network

Abstract

The invention discloses a gesture recognition method and system based on STT-LSTM network. The method includes building an STT-LSTM network model, which contains two layers of STT-LSTM network; the RGB characteristics and optical flow characteristics are transmitted into the first layer STT-LSTM network. During the training of the first layer STT-LSTM network, the global context information is initialized, and the global context information is transmitted to the second layer STT-LSTM network, and is constantly updated iteratively in the second layer STT-LSTM network, and the context information is gradually perfected. The final output nodes of the the second layer STT-LSTM network are reorganized to form a node pipeline containing gesture motion information, which is used as a classification tag for multi-classifier to predict traffic police gestures. The method of the invention can accurately identify the gesture command action, can effectively ensure the smooth and safety of the traffic, and can reduce the accident occurrence probability.

Description

technical field [0001] The invention relates to the technical field of image and video analysis, in particular to a gesture recognition method and system based on an STT-LSTM network. Background technique [0002] With the rapid development of my country's automobile industry, traffic congestion and traffic safety problems also follow. The importance of traffic police in the traffic industry is also increasing. Its main duties are to maintain traffic order, deal with traffic accidents, investigate and correct road traffic violations, and be responsible for the registration and management of motor vehicles. The traffic police gesture is an important tool for the traffic police to ensure the smooth flow and safety of traffic. [0003] The following problems are often encountered when driving a motor vehicle: first, nearly 60% of drivers cannot fully recognize the meaning of the command gestures of the traffic police, resulting in a reduction in the command efficiency of the t...

AI Technical Summary

Problems solved by technology

[0003] The following problems are often encountered when driving a motor vehicle: first, nearly 60% of drivers cannot fully recognize the meaning of the command gestures of the traffic police, resulting in a reduction in the command efficiency of the traffic police, and driving safety cannot be guaranteed; secondly, when driving in rainy and snowy weather or at night, The visibility is low, and the gestures of the traffic police are difficult to recognize; moreover, when the traffic flow is heavy on the traffic control section, due to the blocking of vehicles, the command distance of the traffic police gestures is limited

Images