Human body behavior recognition method based on motion cooperation space

A recognition method and motion technology, applied in the field of human behavior recognition based on motion collaborative space, can solve problems such as not being able to well reflect the integrity and coordination of human motions, single recognition method, etc., to achieve elimination of redundancy, The effect of improving computing efficiency and data integrity

Pending Publication Date: 2022-06-28
CHANGZHOU UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these recognition methods are still relatively simple, and the application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body behavior recognition method based on motion cooperation space
  • Human body behavior recognition method based on motion cooperation space
  • Human body behavior recognition method based on motion cooperation space

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0043] The present invention uses the motion state measurement coefficient to describe the motion changes of various parts of the human body in each action, and combines the individual skeleton data into a comprehensive vector. Redundant data is removed through key frames, the amount of computation is reduced, and then it is fused with depth features to achieve a better recognition effect.

[0044] The present invention extracts the key frame based on the motion state measurement coefficient for the initial bone sequence and the depth map sequence, and then extracts the motion coordination space vector from the processed bone sequence, and splices it into the motion coordination space feature; and extracts the DMM for the processed depth map sequence. feature. Finally, the DMM (Deep Motion Map) feature based on depth data and the SFMI ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human body behavior identification method based on a motion cooperation space. The method comprises the following steps: S1, respectively carrying out key frame extraction based on a motion state measurement coefficient on an initial skeleton sequence and a depth map sequence; s2, extracting motion coordination space vectors from the skeleton sequence processed in the step S1, and splicing the motion coordination space vectors into motion coordination space features; extracting DMM features from the depth map sequence processed in the step S1 to obtain a depth motion map; and S3, inputting the deep motion map and the motion collaborative spatial features into a deep network at the same time, and performing score fusion. Based on the idea of multi-modal fusion, skeleton data and depth data are combined, so that the data are more complete, complementation of various heterogeneous information is realized, redundancy among modals is eliminated, a new behavior recognition method system is established, and a new thought and theoretical basis are provided for research and application of a human body behavior recognition method.

Description

technical field [0001] The invention relates to a method for recognizing human behavior, in particular to a method for recognizing human behavior based on a motion collaborative space. Background technique [0002] Human behavior recognition is one of the research hotspots in the field of computer vision, and many research results have been widely used in image analysis, human-computer interaction, intelligent monitoring, video retrieval, somatosensory games, and health detection. [0003] The related research on behavior recognition can be traced back to an experiment of Johansson in 1973 (GUNNARJOHANSSON.(1973) Visual perception of biological motion and a model for its analysis In Perception&Psychophysics 1973.Vol.14.No.2.201·211), by using 10- The movement of 12 human key nodes is used to describe human motion and identify human behavior. In the early days, behavior recognition research was mainly based on RGB video sequences, but it was limited by factors such as illumi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V20/40G06V40/10G06V40/20G06V10/34G06V10/44G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/241
Inventor 侯振杰钟卓锟施海勇尤凯军
Owner CHANGZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products