Data transmission method, device and system based on data transmission system

Abstract

The present invention provides a data transmission method, device and system based on a data transmission system which are used to reduce the network transmission burden in the retransmission data process. The method comprises the steps of: sending a first request configured to obtain first data to a first management node of at least one management node to allow the first management node to indicate L storage nodes in the at least one storage node to send K data blocks included in first data and first commands of K first information being in one-to-one correspondence with the K data blocks tothe at least one storage node; obtaining M data blocks corresponding to the first data in the L storage nodes and first information being in one-to-one correspondence with the M data blocks; accordingto the M data blocks and the M first information, determining first storage nodes corresponding to the first data blocks having data errors in the M data blocks from the L storage nodes; and sendinga second request to the first storage nodes to allow the first storage nodes to re-send the first data blocks.

Description

technical field [0001] The present application relates to the field of communication technologies, and in particular to a data transmission method, device and system based on a data transmission system. Background technique [0002] Remote direct memory access (Remote Direct Memory Access, RDMA) transfers data to meet the low processing latency requirements of large data transfers. In the storage system, a piece of data may be stored in multiple storage nodes in a distributed manner. When the local server needs to obtain the data, it needs to send a data read request to multiple storage nodes, and each storage node in the multiple storage nodes registers the corresponding memory buffer, and then write the data blocks stored on each storage node into the registered memory buffer in turn, the local server obtains multiple data blocks in the memory buffer, and then combines multiple data blocks, Finally get that data. [0003] After the local server receives the corresponding...

AI Technical Summary

Problems solved by technology

[0003] After the local server receives the corresponding data blocks in turn, it will check whether one or some data blocks are wrong. Once a certain data block is wrong, the local server will ask each of the multiple storage nodes to retransmit the data. Multiple storage nodes need to repeat the above data transmission process, and the retransmission process of multiple storage nodes will consume network bandwidth and increase the burden of network transmission

Images