Hash table concurrent access performance optimization method under multi-core environment

Abstract

The invention discloses a hash table concurrent access performance optimization method under a multi-core environment. The method comprises the steps that aiming at the concurrent connection treatment of high concurrent access of a hash table, a half-synchronous half-asynchronous network connection treatment mechanism is adopted; aiming at the concurrent data treatment of high concurrent access of the hash table, the hash table is divided into multiple independent sub hash tables according to the number of CPU cores, working threads correspond to the independent sub hash tables in a one-to-one mode, and each working thread is only in charge of the data of the corresponding sub hash table; a main thread selects the corresponding working threads to process by adopting a consistent hash strategy according to the Key of each datum; each sub hash table maintains one LRU queue, when a memory space is insufficient, cold data are deleted, and new elements are inserted. The method improves the concurrent connection treatment capacity and the concurrent access capacity of the hash table, and the synchronization overhead problem and the cache consistency overhead problem are solved when the shared hash table is visited by multiple threads.

Description

technical field [0001] The invention belongs to the field of performance optimization of multi-core software, and more specifically relates to a method for optimizing concurrent access performance of a hash table in a multi-core environment. Background technique [0002] A hash table is a commonly used data structure that accesses records by mapping a key value to a location in the table to speed up lookups. Due to its high search efficiency, it is widely used in practical applications such as storage systems and search engines, such as hash indexes in databases and hash table structures in cache systems. A single-core processor improves the performance of the processor by increasing the main frequency, but the resulting power consumption and heat dissipation problems have become a bottleneck for further improvement of the processor speed. Subsequently, processor manufacturers began to expand the CPU horizontally, integrating multiple computing cores on one processor, that ...

AI Technical Summary

Problems solved by technology

Its purpose is to solve the technical problems of high concurrent connection processing, lock contention, cache consistency overhead and system scalability in existing methods

Images