Video generating method, device, electronic device and computer storage medium

A video and target video technology, applied in the field of image processing, can solve problems such as the inability to meet the actual needs of head posture

Active Publication Date: 2022-04-12
BEIJING SENSETIME TECH DEV CO LTD
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In related technologies, the generation of talking faces is an important research direction in voice-driven character and video generation tasks; however, related talking face generation schemes cannot meet the actual needs related to head poses

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video generating method, device, electronic device and computer storage medium
  • Video generating method, device, electronic device and computer storage medium
  • Video generating method, device, electronic device and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] The present disclosure will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the embodiments provided here are only used to explain the present disclosure, not to limit the present disclosure. In addition, the embodiments provided below are some embodiments for implementing the present disclosure, rather than providing all the embodiments for implementing the present disclosure. In the case of no conflict, the technical solutions recorded in the embodiments of the present disclosure can be combined in any manner implement.

[0080] It should be noted that in the embodiments of the present disclosure, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion, so that a method or device comprising a series of elements not only includes the explicitly stated elements, but also include other elements not explicitly listed, or also include el...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

This embodiment discloses a video generation method, device, electronic equipment, and computer storage medium. The method includes: extracting face shape information and head posture information from each frame of face image; Audio clips to obtain facial expression information; according to facial expression information, facial shape information and head posture information, the facial key point information of each frame of human face image is obtained; according to the facial key point information, the pre-acquired Completing the face image to obtain an image for each frame; generating an image according to each frame to generate a target video; Therefore, the target video can reflect the head pose information; and the head pose information is obtained from each frame of face image, therefore, the embodiments of the present disclosure can make the target video meet the actual requirements about the head pose.

Description

technical field [0001] The present disclosure relates to image processing technology, and in particular to a video generation method, device, electronic equipment and computer storage medium. Background technique [0002] In related technologies, the generation of talking faces is an important research direction in voice-driven character and video generation tasks; however, related talking face generation schemes cannot meet the actual needs related to head poses. Contents of the invention [0003] Embodiments of the present disclosure expect to provide a technical solution for video generation. [0004] An embodiment of the present disclosure provides a method for generating a video, the method comprising: [0005] Obtaining multiple frames of human face images and audio clips corresponding to each frame of human face images in the multiple frames of human face images; [0006] Extract the face shape information and the head posture information from each frame of human ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/262H04N5/265G10L25/51G10L25/57G10L25/30G06V40/16
CPCH04N5/262H04N5/265G10L25/51G10L25/57G10L25/30G06V40/174G06V40/168G06T13/40G06T17/00G06F16/7834G06N3/08G06V40/176G06V40/165G06N3/047G06N3/044G06N3/045G06N3/04G06T5/002G06T5/004G06T5/005
Inventor 宋林森吴文岩钱晨赫然
Owner BEIJING SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap