Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video face hallucination method and device based on component decomposition

A face structure and video technology, applied in instruments, graphics and image conversion, computing, etc., can solve problems such as difficulty in achieving results, algorithm performance degradation, and difficulty in applying face gestures, and achieve the effect of improving performance.

Inactive Publication Date: 2017-04-05
PEKING UNIV
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because this kind of method contains the step of aligning the face pictures, it is difficult to achieve the desired effect when the alignment is insufficient or the faces of different angles and poses are input.
[0005] Because most of the current face illusion methods require face images to be highly aligned or relatively similar, when there is a large difference between the test image and the training image, the performance of the algorithm will drop significantly, and the current algorithm is also difficult to apply to human faces. In videos with changing facial postures

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video face hallucination method and device based on component decomposition
  • Video face hallucination method and device based on component decomposition
  • Video face hallucination method and device based on component decomposition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the Some, but not all, embodiments are invented. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0021] Such as figure 1 As shown, the present embodiment discloses a video face illusion method based on component decomposition, including:

[0022] S1. For each frame image of the low-resolution face video to be subjected to face illusion, the face part in the frame image is decomposed according to the face structure, and the decomposed face parts are divided into im...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video face hallucination method and a device based on component decomposition, which can improve the performance of the face hallucination in a low-resolution face video. The method comprises steps: as for each frame of image in the low-resolution face video for face hallucination, the face part in the frame of image is decomposed according to a face structure, and each face part obtained through decomposition is cut into image blocks; as for each image block obtained through cutting, a preset number of nearest neighbor image blocks for the image block is acquired from a preset image block library; as for each frame of image in the low-resolution face video, the nearest neighbor image blocks are used to adopt a local constraint-based neighborhood embedding method to rebuild the image block obtained through cutting the frame of image, high-resolution image blocks are obtained, and through combining the high-resolution image blocks, a target high-resolution image is obtained; and through combining each target high-resolution image, a target high-resolution face video is obtained.

Description

technical field [0001] The invention relates to the technical field of image synthesis and reconstruction, in particular to a method and device for video human face phantom construction based on component decomposition. Background technique [0002] Face phantom refers to reconstructing a corresponding high-resolution face image from an input single-frame low-resolution face image or a multi-frame low-resolution face image sequence. Since face pictures have specific structural features, some methods of face phantom reconstruction model the face structure to perform face super-resolution reconstruction. [0003] Wang and Tang proposed a global face illusion algorithm based on principal component analysis. First, use principal component analysis to project the low-resolution image library to the low-resolution feature space, and then calculate the projection coefficient of the low-resolution image in the low-resolution feature space, and assume that the high-resolution projec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40
CPCG06T3/4053
Inventor 厉扬豪刘家瑛杨文瀚郭宗明
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products