Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-spectrogram fusion method and device for realizing human body posture estimation based on millimeter wave radar

A millimeter-wave radar and human body posture technology, applied in the field of multi-spectral image fusion, can solve the problems of wasting computing resources and storage resources, and the human body posture is reversed from left to right, so as to avoid the introduction of redundant distance features.

Pending Publication Date: 2022-06-17
SUN YAT SEN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current multispectral fusion method faces the following two challenges: one is how to effectively correlate the distance, velocity, and angle information in the two spectrograms. If the association is wrong, the estimated human posture will be reversed; the other is how to avoid redundant The introduction of redundant distance features, if redundant features are introduced, there will be a waste of computing resources and storage resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-spectrogram fusion method and device for realizing human body posture estimation based on millimeter wave radar
  • Multi-spectrogram fusion method and device for realizing human body posture estimation based on millimeter wave radar
  • Multi-spectrogram fusion method and device for realizing human body posture estimation based on millimeter wave radar

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] In order to make those skilled in the art better understand the solutions of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of this application.

[0074] Reference in this application to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-spectrogram fusion method and device for realizing human body posture estimation based on millimeter wave radar, and the method comprises the steps: obtaining a distance-Doppler spectrogram and a distance-angle spectrogram, carrying out the attention matrix calculation of the two obtained spectrograms through a Transform structure, and obtaining the fusion features of the two spectrograms; repairing the fusion features by using the distance-Doppler spectrogram features to obtain complete fusion features; obtaining time sequence features of continuous frames by using a bidirectional long short-term memory network, and performing feature compensation on the time sequence to obtain rough compensation features; for the rough compensation features of each frame, calculating relevance between human joints in the same frame and performing spatial feature compensation according to the relevance to obtain fine compensation features of each frame; and mapping the fine compensation feature of each frame into a human skeleton to complete human posture estimation of the millimeter wave radar. According to the invention, multi-spectrogram fusion is effectively realized, and the accuracy of human body posture estimation realized by the millimeter wave radar is greatly improved.

Description

technical field [0001] The invention belongs to the technical field of human body attitude estimation, and in particular relates to a multispectral image fusion method and device for realizing human body attitude estimation based on millimeter wave radar. Background technique [0002] Human pose estimation is an important task in computer vision, which aims to map the data acquired by sensors into human skeleton, which is widely used in human-computer interaction, activity recognition, monitoring, smart home, etc. Non-wearable sensors currently used for human pose estimation are mainly divided into two categories: optical sensors and radio frequency sensors. Optical sensors face problems such as environmental sensitivity, visual obstruction, and privacy leakage. In contrast, RF sensors have the advantages of strong penetration and privacy protection while being insensitive to the environment. Furthermore, the millimeter-wave radar, which is a radio frequency sensor, has th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G01S13/08G01S13/89G01S13/58G06K9/62G06N3/04G06V10/80G06V10/82
CPCG01S13/08G01S13/89G01S13/58G06N3/044G06N3/045G06F18/253
Inventor 王国利郭雪梅张剑雄
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com