Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Real-time dynamic human body three-dimensional reconstruction method based on inward looking around multiple RGBD cameras

A 3D reconstruction and real-time dynamic technology, applied in the field of 3D reconstruction of the human body, can solve the problems of not being able to achieve the accuracy of the static multi-RGB camera reconstruction system and low accuracy of depth information, and achieve the effects of low cost, simple and convenient construction, and high degree of automation

Inactive Publication Date: 2020-06-16
PLEX VR DIGITAL TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, compared with the static multi-RGB camera reconstruction system, the accuracy of the depth information obtained by the depth camera is lower, and the reconstruction system based on the depth camera cannot reach the accuracy of the static multi-RGB camera reconstruction system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time dynamic human body three-dimensional reconstruction method based on inward looking around multiple RGBD cameras
  • Real-time dynamic human body three-dimensional reconstruction method based on inward looking around multiple RGBD cameras
  • Real-time dynamic human body three-dimensional reconstruction method based on inward looking around multiple RGBD cameras

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The following describes several preferred embodiments of the present invention with reference to the accompanying drawings, so as to make the technical content clearer and easier to understand. The present invention can be embodied in many different forms of embodiments, and the protection scope of the present invention is not limited to the embodiments mentioned herein.

[0050] In the drawings, components with the same structure are denoted by the same numerals, and components with similar structures or functions are denoted by similar numerals. The size and thickness of each component shown in the drawings are shown arbitrarily, and the present invention does not limit the size and thickness of each component. In order to make the illustration clearer, the thickness of parts is appropriately exaggerated in some places in the drawings.

[0051] In this patent, the target high-precision human body model is obtained by using the ordinary dome-type high-definition multi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a real-time dynamic human body three-dimensional reconstruction method based on an inward looking-around multi-RGBD camera, and the method comprises the following steps: S1, building a multi-RGBD camera group, calibrating and collecting data, and obtaining a high-precision model; S2, extracting an embedded node and parameterizing the embedded node; S3, binding embedded nodes to the 3D skeleton, solving motion parameters and optimizing the number of the parameters, and propagating the parameters to the embedded nodes; s4, solving the non-rigid motion; and S5, carrying out real-time mapping. The method is low in implementation cost, simple and convenient to build, high in automation degree and free of manual intervention under the condition of having no special requirements for wearing, action posture, amplitude and speed of a user in a daily scene, and a real-time dynamic high-definition human body three-dimensional model is obtained through a series of algorithms based on a GPU. The method can be widely applied to the fields of remote holographic communication, remote teaching, entertainment and the like.

Description

technical field [0001] The invention relates to the field of three-dimensional reconstruction of human body, in particular to a real-time dynamic three-dimensional reconstruction method of human body based on multiple RGBD cameras looking around inward. Background technique [0002] Real-time high-precision 3D human body reconstruction is a key frontier issue in the fields of computer vision and computer graphics. This technology can be widely used in augmented reality, remote immersive communication, 3D video live broadcast and other fields, and has high research and commercial value. [0003] The current mainstream dynamic human body reconstruction methods are mainly non-real-time reconstruction and single RGBD camera reconstruction technology. At present, the more mature dynamic human body reconstruction methods are mainly based on the reconstruction method of multiple fixed RGB cameras. Obtain color pictures of the human body from multiple different angles, and use met...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T17/00G06T7/80G06T15/20
CPCG06T7/80G06T15/205G06T17/00G06T2207/10004G06T2207/20221G06T2207/30196
Inventor 朱煜虞煌杰金石杨文康
Owner PLEX VR DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com