Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Virtual face synthesis method, system, device and storage medium

A technology of face synthesis and face, which is applied in the direction of equipment, graphics and image conversion, calculation, etc., can solve the problem of unable to modify the face, and achieve the effect of meeting the high requirements of face changing

Pending Publication Date: 2020-04-17
北京拉近众博科技有限公司
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current technology can only realize the face synthesis of a single image, and cannot realize the modification of the face in the video. As the face tracking technology becomes more and more mature, users urgently hope for a method that can modify the face image in the video. technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual face synthesis method, system, device and storage medium
  • Virtual face synthesis method, system, device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Such as figure 1 As shown, the present embodiment provides a method for synthesizing a virtual human face, comprising the following steps:

[0043] S1. Establishing a 3D model of a human face;

[0044] S2. After obtaining the video data, obtain the video sequence and each frame of pictures according to the video data;

[0045] S3, sequentially recognize the faces in the picture, and obtain the position information and contour information of the faces;

[0046] S4. Combining position information, contour information and a preset 3D face model for face synthesis;

[0047] S5. Combining the face-synthesized pictures according to video sequences to generate face-synthesized video data.

[0048] In the method of this embodiment, when the user wishes to virtually replace the face of a person in a certain video with his own face shape, the user's face 3D model is established in advance, and the user's face at various angles can be obtained by establishing the 3D face model ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a virtual face synthesis method, a system, a device and a storage medium, and the method comprises the following steps: obtaining a video sequence and each frame of picture according to video data after the video data is obtained; recognizing faces in the pictures in sequence, and obtaining position information and contour information of the faces; combining the position information, the contour information and a preset face 3D model to carry out face synthesis; and combining the pictures subjected to face synthesis according to a video sequence to generate video data subjected to face synthesis. According to the method, the human face in the video is recognized, and the recognized human face is replaced by combining the preset human face 3D model, so that the humanface in the video is replaced by the own human face, the high requirement of a user for changing the human face in the video is met, more fun is indirectly brought to the user, and the method and thedevice can be widely applied to a video data processing technology.

Description

technical field [0001] The present invention relates to video data processing technology, in particular to a virtual human face synthesis method, system, device and storage medium. Background technique [0002] With the development of image processing technology, many smart terminals now have the function of automatic beautification and PS. Based on face detection technology, users can modify the face on the picture, such as modifying eyebrows and lips, and even replace the face , bringing great pleasure to users. However, the current technology can only realize the face synthesis of a single image, and cannot realize the modification of the face in the video. As the face tracking technology becomes more and more mature, users urgently hope for a method that can modify the face image in the video. technology. Contents of the invention [0003] In order to solve the above technical problems, the object of the present invention is to provide a method, system, device and st...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T13/40G06T19/20G06T3/00
CPCG06T13/40G06T19/20G06T3/04
Inventor 柳晓峰
Owner 北京拉近众博科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products