Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional human body animation reconstruction method

A human body, three-dimensional technology, applied in the field of three-dimensional dynamic graphics processing, can solve the problems of poor user experience, complexity, long modeling time, etc.

Active Publication Date: 2020-08-18
青岛联合创智科技有限公司
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] 3D human body modeling is mainly the process of digitizing the 3D posture information of the human body in reality by using computer graphics and visual methods. It plays an important role in the fields of 3D movies, 3D animation production, 3D games, virtual fitting and virtual reality, etc. 3D human body modeling is one of the current research hotspots in the field of computer graphics; traditional 3D human body reconstruction methods have high requirements for scenes and generally require complex calibration. Traditional 3D human body reconstruction methods often rely on 3D animation production methods such as depth cameras. , high computational complexity, long modeling time, poor user experience, etc.
[0004] The steps of the existing traditional 3D human body reconstruction method are cumbersome and complicated, and the animation conversion needs to be performed by means of 3D animation production methods such as depth cameras. The calculation complexity is high, and the modeling time is long. Insufficient interactive functions and poor user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional human body animation reconstruction method
  • Three-dimensional human body animation reconstruction method
  • Three-dimensional human body animation reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] A method for reconstructing animation of a three-dimensional human body involved in this embodiment, the process steps are as follows:

[0061] S1. Obtain human body three-dimensional pose estimation

[0062] The video frame sequence V={I that continuous 16 frames of images are formed 1 ,I 2 ,...,I 16}, use the HRNet (high resolution network) model to perform high resolution feature extraction on a single image, and obtain a high resolution feature sequence F={f 1 ,f 2 ,..., f 16}, the high-resolution feature sequence F={f 1 ,f 2 ,..., f 16} Input the time generator to obtain the human body posture parameter sequence P={p 1 ,p 2 ,...,p 16}, where the body pose parameter p corresponding to the i-th frame image i =(x i ,X i ,θ i ,β i ); the human body posture parameter sequence P={p 1 ,p 2 ,...,p 16} into the motion discriminator to obtain a sequence of probability values ​​d={d 1 , d 2 ,...,d 16}, judge whether the generated human motion posture sequ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of three-dimensional dynamic graphic processing, and relates to a three-dimensional human body animation reconstruction method. The method comprises the following process steps of S1, selecting a video segment of a single person, and inputting the video segment into a trained generative adversarial network model to obtain a human body articulation pointthree-dimensional rotation angle sequence, S2, adopting a Savizkg-Golag five-point secondary smoothing algorithm to carry out smoothing processing on each three-dimensional articulation point rotation angle in the movement process, S3, creating an initial three-dimensional cartoon model, and binding 23 articulation points of the human body with the same articulation points of articulation pointsof the three-dimensional cartoon model, S4, updating the obtained three-dimensional rotation angle to a three-dimensional cartoon model, and realizing synchronous change of the attitude of the three-dimensional cartoon model by utilizing the rendering effect of Unity3D. According to the method, a generative adversarial network model is adopted, samples do not need to be calibrated, and the earlier-stage sample preparation workload is reduced; by introducing two-dimensional coordinates, three-dimensional coordinates, three-dimensional rotation angles, deviation values of human body shape parameters and confrontation loss values of joint points, the model precision is greatly improved.

Description

Technical field: [0001] The invention belongs to the technical field of three-dimensional dynamic graphics processing, and relates to a method for constructing a three-dimensional posture of a human body, in particular to a method for reconstructing an animation of a three-dimensional human body. Background technique: [0002] 3D human body modeling is mainly the process of digitizing the 3D posture information of the human body in reality by using computer graphics and visual methods. It plays an important role in the fields of 3D movies, 3D animation production, 3D games, virtual fitting and virtual reality, etc. 3D human body modeling is one of the current research hotspots in the field of computer graphics; traditional 3D human body reconstruction methods have high requirements for scenes and generally require complex calibration. Traditional 3D human body reconstruction methods often rely on 3D animation production methods such as depth cameras. , high computational com...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T13/40G06T13/20G06K9/62G06K9/00G06T17/00
CPCG06T13/40G06T13/20G06T17/00G06T7/60G06T2207/10016G06V40/20G06F18/214
Inventor 纪刚周亚敏周萌萌商胜楠周粉粉
Owner 青岛联合创智科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products