Adaptive action recognition method based on multi-view and multi-mode characteristics

Abstract

The invention discloses an adaptive action recognition method based on multi-view and multi-mode characteristics. The adaptive action recognition method specifically comprises the steps of: preprocessing videos; carrying out multi-view description on a target movement variation change; extracting equal-hierarchical pyramid characteristics; constructing a multi-view depth and RGB (Red Green Blue) model; selecting a multi-view model, deducing and integrating multi-mode characteristic results. According to the adaptive action recognition method, firstly, aiming at the difficulties of illumination variation, shadow and the like usually occurring in a process of recognizing visible image actions, action recognition is carried out on the basis of multi-view and multi-mode characteristics; then aiming at the limitation of the single view, multi-view description in the target movement variation process is provided, and is capable of more completely capturing variation processes of a target in a depth and RGB image sequence; then, the equal-hierarchical pyramid characteristics also have a spatial resolving power and a detail description power, thereby having very good robustness and discrimination property; finally, multi-mode characteristics are adaptively integrated according to the variation change of ambient light, and the performance and the stability of the action recognition method are further improved.

Description

technical field [0001] The invention belongs to the technical field of computer vision and pattern recognition, and designs an adaptive action recognition method based on multi-view and multi-modal features, solves the difficulty of using visible light images for action recognition, and improves the accuracy and robustness of action recognition It can be used for the action recognition of human targets in surveillance video and realize the intelligent management of surveillance video. Background technique [0002] With the development of computer technology and information technology, the demand for video-based human motion analysis is becoming more and more urgent. In systems such as intelligent monitoring, home security, intelligent robots, and athlete auxiliary training, motion analysis plays an increasingly important role. role. However, most of the early human action recognition uses ordinary RGB image sequences for action analysis, which will be interfered by factors ...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to solve the problem that the recognition performance of the action recognition method based on visible light is unstable, and when the light changes greatly, for example, at night, its performance will drop sharply. , cannot fully capture the historical change process of the target movement, therefore, the present invention proposes an adaptive action recognition method based on multi-view and multi-modal features, which is used to identify the target action in video surveillance, so as to realize the monitoring video Insight

Images