Distributed processing method, device, computer equipment and storage medium

Abstract

An embodiment of the present invention provides a distributed processing method, DEVICE, COMPUTER DEVICE AND STORAGE MEDIUM, the method is executed by a configuration proxy service provided in a nodeof a distributed network, at first, the configuration access request sent by the first application in the local node is obtained, the network configuration information of each application included inthe distributed network is sent to the first application in response to an access request, so that the first application determines whether the first application and the second application are locatedin the same node according to the received network configuration information of each application. The embodiment of the invention can ensure the locality of the first application and the second application in which the dependency relationship exists, and improve the scheduling flexibility of the first application and the second application.

Description

technical field The embodiments of the present invention relate to the field of network technology, and in particular, to a distributed processing method, device, computer equipment, and storage medium. Background technique A distributed network usually consists of multiple applications, each of which is deployed and operated independently, and each application cooperates with each other through a network interface. For distributed networks, especially data-intensive distributed networks, the requirements for storage and network are very high. If the locality of applications with dependencies is poor, the network overhead of the distributed network will increase when the application is called, and the network traffic will increase. Geometric growth will cause the defect of network congestion. At the same time, network congestion will lead to a rapid increase in network delay. For some distributed applications, network timeout will cause the distributed network to be in an un...

AI Technical Summary

Problems solved by technology

Although the above method can solve the locality problem, it will lead to poor scheduling flexibility for applications with dependencies

Images