Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data transmission method and device for transverse federation learning, terminal equipment and medium

A data transmission method and a technology of a data transmission device, which are applied in the data transmission of horizontal federated learning and the field of computer-readable storage media, can solve the problems of complicated implementation process and loss of training model accuracy, so as to ensure stability and good results, and avoid implementation The effect of complicated process and loss of model accuracy, reducing the amount of data transmission

Active Publication Date: 2020-06-30
WEBANK (CHINA)
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a data transmission method, device, terminal equipment and computer-readable storage medium for horizontal federated learning, aiming to solve the existing problem of horizontal federated learning The training model in federated learning is cut and compressed and then transmitted. The implementation process is complicated and will cause technical problems in the loss of training model accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method and device for transverse federation learning, terminal equipment and medium
  • Data transmission method and device for transverse federation learning, terminal equipment and medium
  • Data transmission method and device for transverse federation learning, terminal equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0059] Such as figure 1 as shown, figure 1 It is a schematic structural diagram of the hardware operating environment involved in the solution of the embodiment of the present invention.

[0060] It should be noted, figure 1 That is, it is a schematic structural diagram of the hardware operating environment of the terminal device. The terminal device in this embodiment of the present invention may be a terminal device such as a PC or a portable computer.

[0061] Such as figure 1 As shown, the terminal device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data transmission method and device for transverse federation learning, terminal equipment and a computer readable storage medium. The method comprises the following steps: receiving a residual pooling model uploaded by each client in transverse federation learning, wherein each client determines a to-be-trained model in transverse federated learning according to an aggregation result received from the server and an initial to-be-trained model, performs local model training on the to-be-trained model by using local training data, calculates a residual error, and performs pooling compression on the residual error to obtain a residual error pooling model; performing preset aggregation operation on the received residual pooling model to obtain an aggregation result;and issuing the aggregation result to each client, so that each client performs a new round of model training according to the aggregation result. According to the invention, the data transmission quantity between the client and the server is reduced, and the problems of complex implementation process and loss of model precision caused by intermediate transmission through model cutting are avoided.

Description

technical field [0001] The present invention relates to the technical field of horizontal federated learning, in particular to a data transmission method, device, terminal device and computer-readable storage medium for horizontal federated learning. Background technique [0002] At present, when the number of clients participating in horizontal federated learning is large, each client uploads data such as model updates at the same time, which will lead to a very heavy operating pressure on the server side of horizontal federated learning, and the model based on machine learning is very complicated. The structure of the model is usually relatively large, which requires each client to establish a communication connection with the server for a long time. In view of the instability of the federated learning communication network environment, the data transmission between each client and the server is easily interrupted. [0003] Currently, in order to reduce the operating press...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/06G06N3/04G06N3/08G06N20/00
CPCH04L69/04G06N3/08G06N20/00G06N3/045
Inventor 黄安埠刘洋陈天健
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products