Method and device for automatically synthesizing three-dimensional expression based on single facial image

Abstract

The invention discloses a method for automatically synthesizing a three-dimensional expression based on a single facial image. The method comprises the following steps of 1, performing facial shape positioning on a single input image by using an ASM (active shape model); 2, finishing facial shape modeling in a scattered interpolation way according to a positioned facial shape by virtue of a three-dimensional facial reference model, and performing texture mapping to obtain a three-dimensional facial model of a target face in the image; 3, calculating a facial expression movement matrix of an expression set relative to the three-dimensional facial reference model and the three-dimensional facial model of the target face; 4, calculating a linear movement model of each expression in the expression set according to the facial expression movement matrix, obtained in step 3, of the three-dimensional facial model of the target face; 5, obtaining a facial area division result of the face by virtue of a clustering method; 6, performing facial expression synthesis. The method is favorable for systematically synthesizing more flexible and richer facial expressions.

Description

technical field [0001] The invention belongs to the related fields of computer vision and computer graphics, and in particular relates to a method and device for automatically synthesizing three-dimensional expressions based on a single face image. Background technique [0002] 3D facial expression synthesis is a computer graphics technology applied in many fields, including movie games, human-computer interaction and face recognition. Synthesizing three-dimensional facial expressions from a single image is a combination of computer vision and computer graphics technology. Its purpose is to extract face information from an image containing a face, and then synthesize various three-dimensional expressions of the face in the image. [0003] Most of the existing facial expression synthesis methods are based on the facial parameter standard, using the MPEG-4 facial animation standard (see Raouzaiou, Amaryllis and Tsapatsoulis, Nicolas and Karpouzis, Kostas and Kollias, Stefanos...

AI Technical Summary

Problems solved by technology

[0004] Most of the existing expression synthesis technologies based on a single image are two-dimensional expression synthesis. The synthesized facial expressions lack a sense of reality, and cannot be observed in three-dimensional and multi-pose; while three-dimensional expression synthesis technologies often require multiple images of a face. Input image (see Fr'ed'eric Pighin, Jamie Hecker, Dani Lischinski, Richard Szeliski, and David HSalesin.Synthesizing realistic facial expressions from photographs.In ACMSIGGRAPH2006Courses, page19.ACM,2006.), or the face features in the input image Selection requires manual operation (Fr'ed'eric Pighin, Jamie Hecker, Dani Lischinski, Richard Szeliski, and David HSalesin. Synthesizing realistic facial expressions from photographs. In ACMSIGGRAPH2006 Courses, page 19. ACM, 2006.), etc.; Most of the methods of regional division are done manually (see Qingshan Zhang, Zicheng Liu, Gaining Quo, Demetri Terzopoulos, and Heung-Yeung Shum. Geometry-driven photorealistic facial expression synthesis. Visualization and Computer Graphics, IEEE Transactions on, 12(1 ):48–60, 2006.)

Images