Federal learning method, system and device based on hierarchical and fragmented block chain

A learning method and blockchain technology, applied in the field of federated learning based on layered and sharded blockchains, can solve problems such as the difficulty of throughput to support large-scale training tasks, avoid the risks of direct sharing and privacy leakage, and avoid Single point of failure risk, effect of reducing transaction processing burden

Active Publication Date: 2021-07-23
BEIJING UNIV OF POSTS & TELECOMM
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a federated learning method, system, and device based on layered and fragmented blockchains to solve the problem of insufficient consideration of the huge demand for computing and storage resources of some consensus algorithms in federated learning. The throughput is also difficult to support large-scale training tasks and other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Federal learning method, system and device based on hierarchical and fragmented block chain
  • Federal learning method, system and device based on hierarchical and fragmented block chain
  • Federal learning method, system and device based on hierarchical and fragmented block chain

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0045]In the federated learning scenario, the traditional federated learning architecture is mostly a master / slave architecture, which requires a centralized server to determine the participants participating in the training and the local models of the participants, and update the global model after aggregation. The performance of this centralized method is limited by the performance of the centralized server, and it is easy to cause network congestion when fac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of block chains and federated learning, and relates to a federal learning method, system and device based on hierarchical and fragmented block chain, and the method comprises the steps that a main chain is constructed and a plurality of sub-chains are triggered through employing an intelligent contract; each sub-chain obtains task information and a basic model from the main chain, packages the task information and the basic model into a sub-chain transaction and submits the sub-chain transaction to the sub-chain; the intelligent terminal selected by each sub-chain main node pulls the task information and the basic model from the corresponding sub-chain for multi-round training; the sub-chain main node aggregates the sub-chain transactions uploaded by the intelligent terminals to obtain a fragmentation model of the round, and packages the fragmentation model into sub-chain transactions and submits the sub-chain transactions to the sub-chain; and each sub-chain main node packages the last round of fragmentation model in each fragmentation iteration into a main chain transaction, submits the main chain transaction to a main chain, and approves part of main chain transactions in the main chain. According to the hierarchical and fragmented block chain structure provided by the invention, the transaction processing burden caused by the fact that a single block chain network bears the whole federated learning task is reduced, and the multi-dimensional gain caused by the fusion of the block chain technology and federated learning is brought into full play.

Description

technical field [0001] The present invention relates to the technical fields of blockchain and federated learning, in particular to a federated learning method, system and device based on layered and fragmented blockchains. Background technique [0002] Federated learning is a machine learning framework. Due to its distributed characteristics, each training participant (terminal or organization) can coordinate all parties to train the same model without uploading local original data, and then meet the requirements of user privacy protection, government Complete information sharing under the requirements of laws and regulations. [0003] In order to solve the security and efficiency problems in traditional federated learning, blockchain technology is introduced into the federated learning architecture in the existing technology to realize decentralized training. However, the existing blockchain-based federated learning fails to fully consider the huge demand for computing an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/20G06F16/27G06F21/62G06Q40/04
CPCG06N20/20G06F16/27G06F21/6245G06Q40/04H04L9/50
Inventor 曹傧袁硕孙耀华彭木根
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products