Expression capturing method and device based on ue engine

Abstract

The invention belongs to the technical field of computer vision, and in particular relates to an expression capturing method and device based on a UE engine. The method aims to solve the problem that the format of the facial expression animation outputted by the prior art is not universal according to the captured facial expression data. The present invention provides an expression capture method based on a UE engine, which includes identifying user expressions according to a pre-built basic expression model; calculating expression weight parameters of user expressions, and converting them into expression weight parameters of pre-built virtual characters; The expression weight parameters of the character are input to the UE virtual engine, and the UE virtual engine renders and outputs the expression of the virtual character. The UE virtual engine of the present invention can output the expression of the virtual character through the preset expression conversion correspondence, so that real-time editing of facial expression animation can be realized, which provides convenience for later development and production.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and in particular relates to an expression capturing method and device based on a UE engine. Background technique [0002] As expression animation is widely used in movies, animations, games and other fields, the vivid expressions of virtual characters bring users a rich visual experience. Facial expression capture is the key technology to achieve real and delicate expression animation. It can not only reproduce real people's expressions on virtual characters, improve the authenticity of virtual characters, but also reduce the cost of manual intervention and labor costs. [0003] Existing facial expression capture schemes include capturing facial expressions based on a single ordinary camera and capturing facial expressions based on Faceware software, wherein capturing facial expressions based on a single ordinary camera is easy to deploy and can be continuously operated in a natural envi...

AI Technical Summary

Problems solved by technology

[0007] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the problem that the facial expression data captured by the prior art cannot be edited with other animations in real time, the present invention provides a method for capturing facial expressions based on UE virtual engine, the method include:

Images