Special effect model training method and device and special effect generating method and device

Abstract

The invention relates to a special effect model training method and device and a special effect generation method and device. The special effect model training method comprises the steps that a training sample set is acquired, wherein the training sample set comprises a plurality of training images; the training images and a first mask graph are input into a special effect model to obtain an output image and a second mask graph after a special effect is added to a preset object in the training images, wherein the first mask graph is the mask graph of the preset object in the training images, and the second mask graph is the mask graph of the preset object after the special effect is added to the output image; the value of a target loss function is determined based on the training images, the output image, the first mask graph and the second mask graph; and the parameters of the special effect model are adjusted based on the value of the target loss function, and the special effect model is trained. According to the invention, the problem that the GAN special effect is not ideal in color, texture and other attributes in the prior art can be solved.

Description

technical field [0001] The present disclosure relates to the field of image processing, and in particular to a method and device for training a special effect model, and a method and device for generating a special effect. Background technique [0002] At present, in common short video applications or camera applications, Generative Adversarial Networks (GAN for short) special effects have become more and more common, such as special effects such as getting old, changing children, comic faces, hand-painting, etc. Or the change of style (such as face attribute or style) is very natural and real, so it is very popular among users. [0003] In related technologies, generally based on image domain (domain) migration schemes, such as cyclegan, stargan and other schemes, the properties of the object to be processed are manipulated to achieve changes in attributes. However, the effect of this scheme on attributes such as color and texture not ideal. Take the hair growth effect as...

AI Technical Summary

Problems solved by technology

[0004] The disclosure provides a special effect model training method and device, special effect generation method and device, to at least solve the problem of unsatisfactory effects of GAN special effects on attributes such as color and texture in the related art

Images