Cross-wide area network data return method, device, computer equipment and storage medium

Abstract

The application discloses a cross-wide area network data return method, device, computer equipment and storage medium. The method includes: adding a pipeline class in the java encapsulation class called by the Hadoop server, and constructing a function for passing in the Redis cluster object and password in the pipeline class; the pipeline class synchronously reads the data to be returned in the Hadoop server, Obtain Redis cluster information; obtain the current Redis cluster information through the pool object; if the current Redis cluster information is different from the previous Redis cluster information, submit the data to be imported back stored in the pipeline class to the Redis database according to the current Redis cluster information server. In this method, the pipeline class submits batch data to the Redis database server only when the Redis cluster information is updated, which reduces the number and time of remote TCP handshakes and improves the efficiency of data return.

Description

technical field [0001] The present application relates to the technical field of cross-wide area network data transmission, in particular to a cross-wide area network data return method, device, computer equipment and storage medium. Background technique [0002] At present, when the Hadoop server and the Redis database server are in different cities or provinces (that is, the two are geographically far apart), the commonly used method is to write back a large amount of data in the Hadoop server to the Redis database through a java program. The server needs to perform a TCP protocol handshake every time data is written back, which leads to low efficiency of writing data back through the java program. Contents of the invention [0003] This application provides a method, device, computer equipment and storage medium for cross-wide area network data return, aiming to solve the problem of writing back a large amount of data in the Hadoop server to the Redis database server th...

AI Technical Summary

Problems solved by technology

[0003] This application provides a method, device, computer equipment and storage medium for cross-wide area network data return, aiming to solve the problem of writing back a large amount of data in the Hadoop server to the Redis database server through a java program in the prior art, and write data every time A handshake of the TCP protocol is required, which leads to the problem of low efficiency of writing data back through the java program

Images