RDMA and HTM based distributed optimistic concurrency control method

Abstract

The invention provides a RDMA and HTM based distributed optimistic concurrency control method, which do not have to acquire a data set of transaction access in advance and do not have to segment a transaction in advance. The control method divides operation of the transaction into two stages: an execution stage and a submission stage. An optimistic concurrency control method and a lock protection method are combined, a read-write set is dynamically maintained during the execution stage of the transaction, and then pre-acquisition of the data set of the transaction can be avoided; Verification is performed and then submission is performed in the submission stage of the transaction, and in this way, pre-segmentation of the transaction can be avoided. Through RDMA and HTM based hardware simplification concurrency control method and decentralization distributed design, the RDMA and HTM based distributed optimistic concurrency control method has excellent expansibility, can conveniently adjust the number of machines according to the demands, and can provide a common feasible solution scheme for high efficient processing of super-large scale concurrent transactions.

Description

technical field [0001] The invention relates to transaction concurrency control in a distributed multi-core memory computing environment, in particular to a distributed optimistic concurrency control method based on RDMA and HTM. Background technique [0002] Distributed multi-core memory computing provides convenience for processing ultra-large-scale concurrent transactions, and its core lies in efficient and general transaction concurrency control methods. Hardware Transaction Memory HTM (Hardware Transaction Memory) and Remote Memory Direct Access RDMA (Remote Direct Memory Access) are two new hardware technologies. The former (HTM) provides hardware support for single-machine transaction concurrency control, which is easy for developers to use and has the advantages of high performance, but it is limited to a single-machine environment. The latter (RDMA) provides hardware support for accessing the memory of the remote machine by the network card, bypassing the processor...

AI Technical Summary

Problems solved by technology

Although the control method using two-stage locks makes good use of two hardware technologies and achieves better performance, its disadvantages are: 1. The data set to be accessed needs to be known in advance before the transaction starts, which not only increases the transaction writing time; The workload of personnel, and for a type of transaction whose data set cannot be pre-determined and only known at runtime, this method becomes infeasible; 2. Existing HTM hardware (such as Intel's RTM) usually has no The size of the set is limited, so the existing method needs to pre-segment the transactions exceeding the limit size in the implementation. The segmentation of the transaction itself is a very complicated task, especially in the case of complex transaction logic, how to correctly Splitting the transaction itself puts extremely high demands on the writers, and for a class of transactions that cannot be split itself, this method also becomes unfeasible

[0004] Therefore, although the existing work uses two hardware technologies to realize distributed concurrent transaction control, it has great limitations in transaction support.

Images