Dynamic human body three-dimensional reconstruction method, device, equipment and medium

A human body and three-dimensional technology, applied in the field of computer vision, can solve the problems of limiting the complexity and speed of reconstructing human motion, and achieve the effect of improving the determination accuracy and robustness

Pending Publication Date: 2020-11-20
BEIJING ZOHETEC CO LTD
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Although the current single-view reconstruction equipment is simple, it limits the complexity and speed of reconstructing human motion to a certain extent.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic human body three-dimensional reconstruction method, device, equipment and medium
  • Dynamic human body three-dimensional reconstruction method, device, equipment and medium
  • Dynamic human body three-dimensional reconstruction method, device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] figure 1 It is a flowchart of a method for dynamic three-dimensional human body reconstruction provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of performing three-dimensional reconstruction on a dynamic human body. The method can be executed by a dynamic human body three-dimensional reconstruction device, and the device can be realized by software and / or hardware. see figure 1 , the dynamic three-dimensional human body reconstruction method provided by the embodiment of the present application, including:

[0034] S110. Reconstruct the three-dimensional human body model according to the RGB image and the depth image of the target human body to obtain the target three-dimensional model of the target human body, wherein the RGB image and the depth image of the target human body are acquired by at least one depth image acquisition device.

[0035] Wherein, the target human body refers to a human body to be three-dimensio...

Embodiment 2

[0080] figure 2 It is a flowchart of a dynamic three-dimensional human body reconstruction method provided in Embodiment 2 of the present application. This embodiment is a specific optimization of the step "estimating the skeletal motion of the target three-dimensional model based on the two-dimensional correspondence and the first three-dimensional correspondence" on the basis of the foregoing embodiments. see figure 2 , the dynamic three-dimensional human body reconstruction method provided by the embodiment of the present application, including:

[0081] S210. Reconstruct the three-dimensional human body model according to the RGB image and the depth image of the target human body to obtain the target three-dimensional model of the target human body, wherein the RGB image and the depth image of the target human body are acquired by at least one depth image acquisition device.

[0082] S220. Perform pose estimation on the target human body according to the RGB image to o...

Embodiment 3

[0099] image 3 It is a flow chart of a dynamic three-dimensional human body reconstruction method provided by Embodiment 3 of the present invention. This embodiment is a specific optimization of the step "estimating the non-rigid motion of the target three-dimensional model based on the two-dimensional correspondence" on the basis of the foregoing embodiments. see image 3 , the dynamic three-dimensional human body reconstruction method provided by the embodiment of the present application, including:

[0100] S310. Reconstruct the three-dimensional human body model according to the RGB image and the depth image of the target human body to obtain the target three-dimensional model of the target human body, wherein the RGB image and the depth image of the target human body are acquired by at least one depth image acquisition device.

[0101] S320. Perform pose estimation on the target human body according to the RGB image to obtain a 2D pose represented by joint points of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic human body three-dimensional reconstruction method, device and equipment and a medium, and relates to the technical fields of computer vision, computer graphics, three-dimensional reconstruction, virtual reality, augmented reality and the like. According to the specific implementation scheme, a human body three-dimensional model is reconstructed according to an RGB image and a depth image, collected based on a single view angle, of a target human body; posture estimation is performed on the target human body according to the RGB image; according to the estimated corresponding relation between the two-dimensional posture and the human body three-dimensional model and the estimated corresponding relation between the three-dimensional posture and the human body three-dimensional model, bone movement and non-rigid movement of the human body three-dimensional model are estimated, and therefore the robustness of dynamic human body three-dimensional reconstruction based on a single view angle is improved. The voxel fusion is performed on the human body three-dimensional model after movement according to the matching result of the semantic information of the target node before and after movement, so that the fusion of the wrong human body surface is avoided.

Description

technical field [0001] Embodiments of the present invention relate to technical fields such as computer vision, computer graphics, three-dimensional reconstruction, virtual reality, and augmented reality. In particular, it relates to a dynamic human three-dimensional reconstruction method, device, equipment and medium. Background technique [0002] In computer vision and computer graphics, reconstruction has been an important research problem in both disciplines, ranging from reconstruction of static scenes, rendering problems to tracking and surface reconstruction of moving objects (especially people). [0003] Although the current single-view reconstruction equipment is simple, it limits the complexity and speed of reconstructing human motion to a certain extent. How to improve the robustness of 3D reconstruction of dynamic human body based on single view has become one of the problems to be solved urgently in this field. Contents of the invention [0004] The inventio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/55G06T17/10G06T19/20
CPCG06T7/55G06T17/10G06T19/20G06T2200/08G06T2207/10004G06T2207/10024G06T2207/10028
Inventor 方璐苏卓许岚温建伟袁潮
Owner BEIJING ZOHETEC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap