Second level method and device and computer readable storage medium

Abstract

The invention relates to a big data technology, and discloses a second-level caching method, which comprises the following steps: obtaining an original data set obtained from a webpage, and dividing the original data set into high-frequency data, common data and fuzzy data; creating a first-level cache in a local process, and storing the high-frequency data into the first-level cache; building a common second-level cache outside the local process, and storing the common data into the common second-level cache; constructing a fuzzy secondary cache outside a local process, and storing the fuzzydata into the fuzzy secondary cache; and receiving a query command input by a client, performing data query on the query command according to the first-level cache, the common second-level cache and the fuzzy second-level cache, and returning a query result to the client. The invention further provides a second-level caching device and a computer readable storage medium. According to the second-level caching method, efficient storage and query of data are realized.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a secondary cache method, device and computer-readable storage medium based on in-process + out-of-process. Background technique [0002] At present, the popular cache in the industry is divided into two types: in-process cache and out-of-process cache. The in-process cache includes Ehcache / guava cache, etc., and its application allows the same JVM memory. The main disadvantage is that the available memory capacity of the application is low, which limits the throughput of the application. , updates consume resources and do not support sharing between apps. The commonly used out-of-process cache is memcached. The main disadvantage is that it is shared by multiple applications. If there is a problem, it will have a huge impact, and if the number of connections goes online, there will be contention for high-concurrency hotspot data. Contents of the invention [0003] The...

AI Technical Summary

Problems solved by technology

[0002] At present, the popular cache in the industry is divided into two types: in-process cache and out-of-process cache. The in-process cache includes Ehcache / guava cache, etc. The application allows the same JVM memory, but the main disadvantage is that the available memory capacity of the application is low, which limits the throughput of the application. , updates consume resources and do not support inter-app sharing

The commonly used out-of-process cache is memcached. The main disadvantage is that it is shared by multiple applications. If there is a problem, it will have a huge impact, and if the number of connections goes online, there will be contention for high-concurrency hotspot data.

Images