Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Image generation method based on adaptive gradient cutting under differential privacy protection

A differential privacy, image generation technology, applied in 2D image generation, image enhancement, image analysis and other directions, can solve problems such as unreasonable cropping and adding noise, and achieve the effect of fast training convergence and high image quality.

Pending Publication Date: 2022-03-11
BEIHANG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0049] The invention discloses an image generation method based on adaptive gradient cropping under differential privacy protection, which solves the problem of excessive noise and unreasonable cropping in the previous generation model algorithm based on privacy protection under the gradient clipping method based on training data. At the same time, the distribution method of the clipping threshold under the gradient clipping method based on the model layer is improved, and the efficiency of network learning is accelerated under the premise of using a reasonable distribution of the clipping threshold, and the gradient added after clipping is further reduced when a finer clipping granularity is selected. the size of the noise

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image generation method based on adaptive gradient cutting under differential privacy protection
  • Image generation method based on adaptive gradient cutting under differential privacy protection
  • Image generation method based on adaptive gradient cutting under differential privacy protection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] The generation network needs to be trained with massive data to generate realistic image data, and the gradient during the training process or the leakage of the network weight after the training may allow the attacker to guess whether a certain data is training or not through model inference attacks or member inference attacks. data. Therefore, in order to ensure the privacy of the training process of the generative model, the generative network consists of two parts, namely the discriminator and the generator. Both are neural networks, so the training process is similar, roughly inputting the training data into the network to obtain the result, calculating the loss function based on the result, and deriving the loss function to obtain the gradient of the discriminator or generator. According to the post-processing nature of differential privacy, as long as the training process of discriminator meets differential privacy protection, the training process of generator na...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image generation method based on adaptive gradient cutting under differential privacy protection, and solves the problems of excessive noise and unreasonable cutting in a gradient cutting method based on training data in a conventional privacy protection-based model generation algorithm. Meanwhile, a cutting threshold distribution method based on a model layer gradient cutting method is improved, the efficiency of network learning is improved on the premise that the cutting threshold is reasonably distributed, and the magnitude of gradient noise added after cutting is further reduced under the condition that finer cutting granularity is selected. Therefore, the method can provide a more reasonable gradient cutting mode and lower noise addition. Compared with the prior art, the method has the advantages that the generation model can be more quickly converged to a local optimal solution under the conditions of more appropriate cutting and smaller noise addition, and the purpose of generating a high-quality picture is achieved.

Description

technical field [0001] The present invention relates to the field of differential privacy and artificial intelligence. It uses differential privacy technology to ensure the privacy of training data in machine learning scenarios, and uses adaptive tailoring technology to ensure the availability of the adversarial generation network model after gradient noise. A privacy-preserving approach to high-quality image generation. Background technique [0002] Machine learning is an integral part of today's society. Every aspect of people's lives, from food delivery to short videos, to medical education, cannot do without the help of machine learning algorithms. Although machine learning facilitates human society, this convenience is not without cost. Machine learning models require a large amount of training data to ensure the availability and robustness of the model. However, the current means of attacking machine learning can already infer whether a certain data is in the trainin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T11/00G06N3/04G06N3/08
CPCG06T11/00G06N3/08G06T2207/20132G06T2207/20004G06N3/045
Inventor 姚燕青林建辰翟征德
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products