A data processing method and device

Abstract

The present invention discloses a data processing method and device. The method includes: grouping storage devices in a storage system, and the number of storage devices in each group is the same as the number of data copies. The method includes: receiving An address request for requesting a data loading address; determine the target group and the address of the target data block on each storage device in the target group according to the address request; return to the client the address of the target data block on each storage device in the target group, This enables the client to initiate a data loading request to the storage devices in the corresponding group according to the addresses of the target data blocks on the storage devices in the target group. By adopting the method provided by the invention, the number of locked storage devices can be reduced, and the probability of deadlock in the storage system can be reduced.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a data processing method and device. Background technique [0002] Transaction processing (TRANSACTION) is a logical processing unit formed by combining one or more SQL (Structured Query Language, Structured Query Language) statement sequences. Each statement in transaction processing is a part of the work to complete the whole task, and all the statements are organized together to complete a specific task. When DBMS (Database Management System, database management system) processes statements in transaction processing, it follows the following agreement, that is, "all statements in transaction processing are regarded as an atomic work unit, and all statements can be executed successfully, or none of the statements executed". The DBMS is responsible for completing this agreement, even in various unexpected situations such as abnormal exit of the application progr...

AI Technical Summary

Problems solved by technology

[0005] The above technical solutions can easily cause a large number of data nodes to be locked, resulting in a large amount of data deadlock, such as figure 1 As shown, there are 8 storage devices, and each storage device is a node. Suppose a transaction needs to update data block 2. At this time, the transaction will load the table lock operation, so that the data on the entire storage device cannot be operated. Block 2 is located on storage devices 1, 2, and 4. Due to the table lock operation, data block 1 on storage device 1 and data block 5 on storage device 4 will be locked, and so on, all storage devices will be locked , it can be seen that when a data block is locked in the existing technology, a large number of irrelevant storage devices are locked at the same time, thus affecting the services that the distributed storage system can provide

Images