Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image processing method and device, equipment and storage medium

An image processing and image technology, applied in the field of image processing, can solve the problems of face distortion, position overlap, etc., to avoid the effect of face distortion

Pending Publication Date: 2021-10-12
GUANGZHOU HUYA TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the process of implementing the present invention, the inventor found that the prior art has the following defects: in the driving face and the virtual face corresponding to the driving face, if some of the key points of the face are relatively close to each other, then when When the expression of the driving face changes, the key points of the virtual face that are closer in the virtual face image will overlap after corresponding adjustments, resulting in deformation and distortion of the face in the driven virtual face image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing method and device, equipment and storage medium
  • Image processing method and device, equipment and storage medium
  • Image processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] Figure 1a It is a flow chart of an image processing method in Embodiment 1 of the present invention. This embodiment is applicable to the situation where the historically driven face follows the driving face to perform expression transformation in real time. This method can be executed by an image processing device. The apparatus can be realized by hardware and / or software, and can generally be integrated in equipment providing image processing services. like Figure 1a As shown, the method includes:

[0060] Step 110, according to the current driving face image frame and the adjacent historical driving face image frames, determine a motion feature parameter set corresponding to each face key point in the historical driving face.

[0061] In this embodiment, the current driving face image frame and the adjacent history driving face image frame are all video images intercepted from the live video, and the interception time of the historical driving face image frame is e...

Embodiment 2

[0079] Figure 2a It is a flowchart of an image processing method in Embodiment 2 of the present invention. This embodiment may be combined with various optional solutions in the foregoing embodiments. Specifically, refer to Figure 2a , the method may include the following steps:

[0080] Step 210 , in the current driving face image frame, the historical driving face image frame and the historical driven face image frame, respectively acquire face key points matching the face area.

[0081] In this embodiment, in order to make the historically driven face in the historically driven face image frame follow the historically driven face in the historically driven face image frame to make corresponding action effects, it is necessary to Frame, historical driving face image frame and historical driven face image frame, obtain the face key points matching the face area respectively, and then determine the history driving face image frame and the current driving face image frame ...

Embodiment 3

[0101] image 3 It is a schematic structural diagram of an image processing device in Embodiment 3 of the present invention. This embodiment is applicable to the case where the historically driven face follows the driving face to perform expression transformation in real time. like image 3 As shown, the image processing device includes:

[0102] The motion feature parameter set generation module 310 is used to determine the motion feature parameter set corresponding to each face key point in the historically driven face according to the current driving face image frame and adjacent historically driven face image frames;

[0103] The image blur processing module 320 is used to map each motion feature parameter in the motion feature parameter set to a texture image to obtain a motion texture image, and perform image blur processing on the motion texture image;

[0104] The face driving module 330 is configured to generate a motion feature adjustment parameter set according to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses an image processing method and device, equipment and a storage medium. The method comprises the following steps: determining a motion feature parameter set corresponding to each face key point in a historical driving face according to a current driving face image frame and an adjacent historical driving face image frame; mapping each motion feature parameter in the motion feature parameter set into a texture image to obtain a motion texture image, and performing image blurring processing on the motion texture image; and generating a motion feature adjustment parameter set according to the blurred image, and generating a current driven face image frame according to the motion feature adjustment parameter set and a historical driven face image frame. According to the technical scheme provided by the embodiment of the invention, when the driven face image follows the driving face image to carry out corresponding face expression adjustment, the face in the adjusted driven face image can be prevented from being distorted and deformed.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image processing, and in particular, to an image processing method, device, device, and storage medium. Background technique [0002] With the development of society, electronic devices such as mobile phones and tablet computers have been widely used in learning, entertainment, and work. Many electronic devices are equipped with cameras for taking pictures, video recordings, and live broadcasting. When the image data of the camera contains a human face, it is also possible to make the static virtual human face image follow the expression transformation of the human face to achieve various action effects. [0003] At present, according to the position correspondence between the key points of the face in the driving face image and the key points of the virtual face in the virtual face image, the key points of each virtual face can be changed correspondingly following the key points of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/40G06T7/20G06T5/00G06K9/62G06K9/00G06T11/40
CPCG06T7/40G06T7/20G06T11/40G06T5/70
Inventor 华路延
Owner GUANGZHOU HUYA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com