Systems and methods for voice personalization of video content

Abstract

Systems and methods are disclosed for performing voice personalization of video content. The personalized media content may include a composition of a background scene having a character, head model data representing an individualized three-dimensional (3D) head model of a user, audio data simulating the user's voice, and a viseme track containing instructions for causing the individualized 3D head model to lip sync the words contained in the audio data. The audio data simulating the user's voice can be generated using a voice transformation process. In certain examples, the audio data is based on a text input or selected by the user (e.g., via a telephone or computer) or a textual dialogue of a background character.

Description

RELATED APPLICATIONS[0001]This application claims priority benefit under 35 U.S.C. § 119(e) to the following United States provisional patent applications, each of which is hereby incorporated herein by reference in its entirety to be considered part of this specification:[0002]U.S. Provisional Patent Application No. 60 / 989,251, filed Nov. 20, 2007, and entitled “SYSTEMS AND METHODS FOR GENERATING A 3D MODEL OF A HEAD AND FACE”;[0003]U.S. Provisional Patent Application No. 61 / 014,353, filed Dec. 17, 2007, and entitled “INTERACTIVE ADVERTISING AND NETWORK ACCESSIBLE CONTENT”;[0004]U.S. Provisional Patent Application No. 61 / 014,680, filed Dec. 18, 2007, and entitled “SYSTEMS AND METHODS FOR VOICE PERSONALIZATION OF VIDEO CONTENT”; and[0005]U.S. Provisional Patent Application No. 61 / 015,083, filed Dec. 19, 2007, and entitled “USER COMPOSITION TOOLS AND METHODS FOR CUSTOMIZING IMAGE DATA.”[0006]The present application is also related to the following applications filed on even date here...

AI Technical Summary

Benefits of technology

"The patent describes a system and method for creating individualized three-dimensional models of a human head. This technology can be used to create personalized media content, such as videos and advertisements, that feature a user's likeness. The system automatically generates a 3D head model based on multiple 2D images of the user's head, which can be customized with hair, eyewear, and other accessories. The user can also store and use these personalized models for online interaction with other users. The technology uses advanced techniques to blend multiple basis head models to create a highly accurate and realistic 3D head model. Overall, this technology allows for easy and rapid creation of personalized media content that can be used for social interaction and advertising."

Problems solved by technology

One of the most intriguing and difficult problems in computer graphics is the creation of life-like human models and the photorealistic animation of those human models.

This technique often results in a distorted image that varies substantially from the individual's actual head proportions.

The accuracy of this technique may be high for reproducing a life-like model, but such systems can be prohibitively expensive for most consumers.

As can be seen, these and other model-generation techniques, have significant drawbacks in that (i) they do not accurately reproduce a model of a user's head, (ii) they can require substantial knowledge to operate, and / or (iii) they are not applicable in many applications in which the average consumer desires them.

Images