Systems and methods for voice personalization of video content

Abstract

Systems and methods are disclosed for performing voice personalization of video content. The personalized media content may include a composition of a background scene having a character, head model data representing an individualized three-dimensional (3D) head model of a user, audio data simulating the user's voice, and a viseme track containing instructions for causing the individualized 3D head model to lip sync the words contained in the audio data. The audio data simulating the user's voice can be generated using a voice transformation process. In certain examples, the audio data is based on a text input or selected by the user (e.g., via a telephone or computer) or a textual dialogue of a background character.

Description

RELATED APPLICATIONS[0001]This application claims priority benefit under 35 U.S.C. § 119(e) to the following United States provisional patent applications, each of which is hereby incorporated herein by reference in its entirety to be considered part of this specification:[0002]U.S. Provisional Patent Application No. 60 / 989,251, filed Nov. 20, 2007, and entitled “SYSTEMS AND METHODS FOR GENERATING A 3D MODEL OF A HEAD AND FACE”;[0003]U.S. Provisional Patent Application No. 61 / 014,353, filed Dec. 17, 2007, and entitled “INTERACTIVE ADVERTISING AND NETWORK ACCESSIBLE CONTENT”;[0004]U.S. Provisional Patent Application No. 61 / 014,680, filed Dec. 18, 2007, and entitled “SYSTEMS AND METHODS FOR VOICE PERSONALIZATION OF VIDEO CONTENT”; and[0005]U.S. Provisional Patent Application No. 61 / 015,083, filed Dec. 19, 2007, and entitled “USER COMPOSITION TOOLS AND METHODS FOR CUSTOMIZING IMAGE DATA.”[0006]The present application is also related to the following applications filed on even date here...

AI Technical Summary

Benefits of technology

[0017]In view of the foregoing, what is needed are improved systems and methods for generating individualized three-dimensional (3D) models of a human head. In certain embodiments, such systems and methods can be used to composite a digital likeness of a user into various forms of background media content, such as video clips, video games, computer games, movies, TV shows, and advertisements. For example, with the advanced features of the Internet and communications devices, it is desirable to provide 3D modeling and animation systems and methods that enable the typical user to rapidly and easily generate a highly accurate, individualized 3D model from his or her image that can be used to create a virtual 3D personality for online interaction with other users.

[0021]Certain embodiments of the invention provide for an end-user composition tool that allows a user to create a personalized piece of image content (e.g., video and / or a still image). The composition tool can comprise, for example, a computer software program executable on a user computer and / or remote server that facilitates compositing a 2D or 3D representation of an individual (e.g., the user) into an image or video template. In certain embodiments, the composition tool allows a user to create new personalized media templates. In other embodiments, a user simply selects a predefined background template and the system automatically generates personalized media content incorporating the user's 3D head model.

[0023]In addition, certain embodiments of the invention enable a user to personalize video content with a voice track. For instance, certain systems and methods allow an individualized 3D head model to be inserted into a video template and facially animated so as to “lip sync” the corresponding voice track. In certain embodiments, the voice track is generated by capturing voice signals of the user through a microphone or other like input device of a computing device. In other embodiments, the voice track can be advantageously generated from voice signals captured through a telephone, such as a landline phone or a cell phone. In yet other embodiments, a user can customize the voice track or corresponding facial animation of the 3D head model by selecting one or more predetermined emotional expressions from a graphical user interface.

Problems solved by technology

One of the most intriguing and difficult problems in computer graphics is the creation of life-like human models and the photorealistic animation of those human models.

This technique often results in a distorted image that varies substantially from the individual's actual head proportions.

The accuracy of this technique may be high for reproducing a life-like model, but such systems can be prohibitively expensive for most consumers.

As can be seen, these and other model-generation techniques, have significant drawbacks in that (i) they do not accurately reproduce a model of a user's head, (ii) they can require substantial knowledge to operate, and / or (iii) they are not applicable in many applications in which the average consumer desires them.

Images