A Privacy Preserving Method for Collaborative Deep Learning Model Training

A deep learning and model training technology, applied in the field of privacy protection, can solve the problems of high computational overhead and inability to guarantee the accuracy of model training, and achieve the effect of achieving fairness, realizing safe publishing, and ensuring data privacy.

Active Publication Date: 2022-05-13
XIDIAN UNIV +1
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The present invention proposes a privacy protection method for collaborative deep learning model training, which can solve the problem of multi-source data-oriented deep learning model security training, and solve the problems of traditional privacy protection schemes such as high computational overhead and model training accuracy cannot be guaranteed. In order to provide technical support for large-scale security applications of deep learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Privacy Preserving Method for Collaborative Deep Learning Model Training
  • A Privacy Preserving Method for Collaborative Deep Learning Model Training
  • A Privacy Preserving Method for Collaborative Deep Learning Model Training

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments, where the schematic embodiments and descriptions of the present invention are used to explain the present invention, but not to limit the present invention.

[0051] The present invention designs a privacy protection system for collaborative deep learning model training, which is composed of a key generation center, a parameter server and multiple participants. The key generation center is mainly responsible for generating keys and distributing keys for parameter servers and participants. In this system, the key generation center is the only trusted entity; the parameter server is mainly responsible for managing the global parameters of the deep learning model, and providing certain computing power to update the model parameters. In this system, the parameter server is a semi-trusted entity that can correctly manage data and implement calculati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a privacy protection method for collaborative deep learning model training, including: proposing a collaborative distributed deep learning model training method, participants use existing training data to calculate the gradient of model parameters locally, and calculate the obtained The gradient data of the model is sent to the parameter server to update the model parameters; a privacy protection mechanism based on the double trapdoor public key cryptography algorithm is proposed, so that the participants can realize the security training of the deep learning model on the premise of ensuring the privacy of their own training data; the detailed design The granular deep learning model release method ensures that only the data owners who participate in the training can obtain the model, ensuring the fairness of model training. The results of the simulation test show that the present invention can provide accurate model training services under the premise of ensuring the data privacy of the participants. It can provide privacy protection for next-generation computer technologies such as artificial intelligence.

Description

technical field [0001] The invention belongs to the field of information security and relates to a privacy protection method, which can be used for collaborative security training of deep learning models in large-scale data. Background technique [0002] Machine learning is becoming a new engine for the development of the digital economy, especially driven by new theories and technologies such as mobile Internet, big data, supercomputing, sensor networks, and brain science, as well as the strong demand for economic and social development, machine learning will further empower All walks of life can promote the in-depth development of the digital economy. As a branch of machine learning, deep learning has also received more and more attention in industry and academia, and is widely used in medical diagnosis, speech recognition, image recognition and other fields. Deep learning is often based on massive data for model training. By analyzing the hidden correlation between data,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F21/60G06F21/62H04L9/00G06N3/04G06N3/08
CPCG06F21/602G06F21/6245H04L9/008G06N3/08G06N3/044
Inventor 马鑫迪卢锴马建峰沈玉龙习宁卢笛李腾冯鹏斌谢康
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products