Multi-mechanism collaborative learning system and method based on hierarchical parameter server

Abstract

The invention discloses a multi-mechanism collaborative learning system based on a hierarchical parameter server. The multi-mechanism collaborative learning system comprises a central mechanism and aplurality of participation mechanisms connected with the central mechanism through a WAN network. Based on the system, the invention further discloses a multi-mechanism collaborative learning method based on the hierarchical parameter server. According to the method, the data island problem of big data is solved, the data privacy safety problem during multi-party cooperation is solved, and the problems of high communication cost, high maintenance cost, high safety risk and low resource utilization rate of an existing system are solved. On the premise of ensuring data privacy safety, efficientcommunication and efficient calculation multi-party collaborative learning is realized, and the method is suitable for cross-domain interconnection of multiple independent mechanisms and multiple datacenters. The system provided by the invention supports a platform mode and a participation mode, can be used as a platform to provide multi-party knowledge fusion service, and can also be used as a tool to support sharing cooperation among a plurality of independent mechanisms.

Description

technical field [0001] The invention belongs to the field of electronic technology, and in particular relates to a multi-institution collaborative learning system and method based on a layered parameter server. Background technique [0002] In the 5G era of high-speed interconnection of everything, the speed of data collection and the amount of data accumulation have exploded, marking that human society has truly entered the era of big data. Big data puts forward higher requirements for data mining capabilities, and the rapid development of artificial intelligence provides powerful data mining and analysis capabilities for many frontier scientific fields, enabling intelligent applications to extract core knowledge from huge amounts of data, and Organically combine these knowledge to perform complex tasks such as detection, recognition, prediction, decision-making, generation, etc., such as Alipay's face recognition, China Customs' face detection, Douyin short video human bod...

AI Technical Summary

Problems solved by technology

[0007] Aiming at the above-mentioned deficiencies in the prior art, a multi-institution collaborative learning system and method based on a layered parameter server provided by the present invention solves the data island problem of big data, solves the data privacy security problem during multi-party collaboration, and solves the problem of High communication costs, high maintenance costs, high security risks, and low resource utilization of existing systems

Images