Method for composing audio/video file by voice driving head image

Abstract

The invention relates to a method for compounding head pictures into video files in the drive of sound. The method comprises the steps as follow: a fixed digital head picture is captured; the data coordinates of the head, the face and the facial features are picked up and the picture animation mode data is counted; a closed mouth frame, an open mouth frame and an expression frame and a picture characteristics data file including the quantity of the three picture frames are generated; a sound digital information is collected; the sound characteristics data is analyzed and picked up so as to generate a sound characteristics data file including a voice sound frame and an assonant sound frame; the picture characteristics data file and the sound characteristics data file are compounded in-phase, so that the voice sound frame is corresponding to the open mouth frame, and the assonant sound frame is corresponding to the closed mouth frame, and then outputting. The invention has the advantages of vivid pictures, achieving the animation on human facial and animal facial expression, easy and simple production and being convenient for generalization and use.

Description

technical field [0001] The invention relates to a method for synthesizing audio-visual files with speech and images, in particular to a method for synthesizing audio-visual files with voice-driven head images. Background technique [0002] Voice signals and visual signals are important means for human beings to learn and communicate, and the comprehensive use of voice signals and visual signals makes people understand and master information more quickly and conveniently. Voice-driven image is just such a multimedia technology that comprehensively considers sound and image. Voice-driven image refers to the use of voice to drive the changes in mouth shape, facial expressions and movements expressed by people when communicating in language. It can convey the meaning that people want to express to a certain extent, and can help people deepen their understanding of language. . In the process of computer human-computer interaction or in the third-generation mobile communication ...

AI Technical Summary

Problems solved by technology

This method has limitations in three aspects: one is that the face video (i.e. dynamic image) must be obtained in advance, that is to say, it cannot be processed according to a single static image; the other is that statistical analysis and modeling are required, that is, Establishing a huge database requires a lot of manpower and material resources, and the production cycle is long, which is not convenient for general promotion; third, it is difficult to collect dynamic data of animal faces, and its animation effect is difficult to achieve

Images