Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human body activity recognition system and method based on conditional variational auto-encoder

An autoencoder and human activity technology, applied in the field of human activity recognition, can solve the problems of difficulty in selecting the window size, hindering the accuracy of activity recognition, and inability to fully mine the similarity between classes, so as to improve the accuracy and generalization. effect of ability

Active Publication Date: 2019-07-16
SUN YAT SEN UNIV
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are some problems with this preprocessing. First, the sensor sampling samples contained in the subsequence do not necessarily all have the same activity label, and the subsequence may contain samples of two or more types of activities. At the same time, in practical applications, the optimal The selection of the window size is also a difficult problem
On the other hand, although deep models such as convolutional neural networks have achieved promising results, there are still many unsolved problems
For example, existing deep models cannot explicitly model the correlation of samples of the same class, i.e., cannot fully mine the inter-class similarity of activities
And this also hinders the further improvement of activity recognition accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body activity recognition system and method based on conditional variational auto-encoder
  • Human body activity recognition system and method based on conditional variational auto-encoder
  • Human body activity recognition system and method based on conditional variational auto-encoder

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0048] The OPPORTUNITY data set of activity recognition in this embodiment is taken as an example, and the implementation manner is described in detail.

[0049] The OPPORTUNITY data set is a data set used to evaluate the effect of the activity recognition model, and it includes many activity recognition tasks of different semantic levels. This embodiment selects gesture recognition of intermediate semantics for specific description. Gesture recognition includes 17 kinds of real activities and 1 inactive state. The inactive state can indicate that the person does not take any gesture at this time. These 17 gestures are collected in the real scene of preparing breakfast, so these gestures involve the interaction process with some furniture in the kitchen. The 17 real poses are shown in Table 1:

[0050] Table 1 Summary of pose names

[0051]

[0052]

[0053] This embodiment provides a system for human body activity recognition based on conditional variational autoencod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a human body activity identification system and method based on a conditional variational auto-encoder, and the method comprises the steps: obtaining an original time sequence:obtaining sampling samples through a sensor, and enabling a plurality of sampling samples to form the original time sequence; constructing batch data: constructing the batch data in a data enhancement mode of a random sequence starting point to obtain constructed sensor batch data X and corresponding activity label batch data Y; training a condition variation auto-encoder model: inputting batch data into the model, and training the model through a loss function and a back propagation algorithm; predicting human body activities: inputting the sensor batch data X as test data into the trained variational auto-encoder model, and inputting the batch data into the variational auto-encoder model to obtain a final prediction activity tag. According to the method, one sampling sample is used as aunit to predict the corresponding activity label, the real-time activity recognition capability is achieved, modeling can be conducted on the correlation of similar samples, and therefore the recognition accuracy is improved.

Description

technical field [0001] The present invention relates to human body activity recognition based on wearable devices, focusing on human body activity recognition based on a prediction unit of a sampling sample, and in particular to a human body activity recognition system and method based on a conditional variational autoencoder. Background technique [0002] Human Activity Recognition (HAR), also known as wearable sensor-based activity recognition, in this problem, we need time series triggered by sensors worn on the human body (such as three-axis accelerometer and heart rate meter) , to identify the current activity or posture of the person. Activity recognition has been one of the fundamental problems for many applications, such as fall detection, gesture recognition, etc. All in all, human activity recognition plays a very important role in many fields such as ubiquitous computing, intelligent care and behavior analysis. [0003] The general framework of human activity re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/084G06V40/23G06N3/045G06F18/214
Inventor 郭雪梅张玮嘉谢泳伦
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products