Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Portrait-based video generation method and device, and storage medium

A portrait and video technology, which is applied in the field of portrait-based video generation methods and devices, and storage media, and can solve problems such as lack of universality.

Pending Publication Date: 2020-07-07
SHANGHAI XIAOI ROBOT TECH CO LTD
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, this method needs to be modeled for a specific portrait. If a portrait is replaced, the model needs to be readjusted, which is not universal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Portrait-based video generation method and device, and storage medium
  • Portrait-based video generation method and device, and storage medium
  • Portrait-based video generation method and device, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] As mentioned earlier, the current method of generating portrait-based videos based on modeling based on a specific portrait is not universal enough.

[0044] In view of the above problems, the embodiment of the present invention uses the trained Generative Adversarial Networks (GANs) to perform corresponding feature extraction processing and feature fusion on the input target face static image and portrait expression control data, and generate an image sequence , and output the generated image sequence when it is determined that the generated image sequence reaches a preset authenticity threshold. Using the video generation method of the embodiment of the present invention, it is not necessary to carry out special modeling for a specific portrait, so when the target portrait is replaced, it is not necessary to readjust the trained generation confrontation network model, so it has stronger universality It can also reduce the cost of video generation because it does not n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention provide a portrait-based video generation method and device, and a storage medium. The method comprises: obtaining a target face static image; obtaining portrait expression control data; inputting the target face static image and the portrait expression control data into a trained generative adversarial network model to perform corresponding feature extraction processing and feature fusion respectively to generate an image sequence, and matching the action posture of the portrait in the image sequence with the expression features of the portrait expression controldata; and outputting the generated image sequence. By adopting the method, the universality of portrait-based video generation can be improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of video processing, and in particular, to a portrait-based video generation method, device, and storage medium. Background technique [0002] Avatars are computer-generated portraits. At present, the method of video generation based on portraits is mainly to synthesize three-dimensional animation characters through computer graphics technology, and use animation parameters to drive the facial and head expressions of the human face. [0003] However, this method needs to be modeled for a specific portrait. If a portrait is replaced, the model needs to be readjusted, which is not universal. Contents of the invention [0004] Embodiments of the present invention provide a portrait-based video generation method, device, and storage medium, so as to improve the universality of portrait-based video generation. [0005] An embodiment of the present invention provides a portrait-based vide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T13/40
CPCG06T13/40
Inventor 王慧朱频频
Owner SHANGHAI XIAOI ROBOT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com