Cached data loading method and apparatus

Abstract

The invention discloses a cached data loading method and apparatus. The method comprises the steps of scanning a service access layer and identifying an interface containing preset automatic loading information; loading data, corresponding to the identified interface containing the automatic loading information, in a database according to preset cache parameter information, and performing caching; and when data of an accessed business is the data corresponding to the interface containing the automatic loading information, reading the cached data to realize business access processing, wherein the cache parameter information includes preset data discrimination identifier information, caching condition information and / or expiration time. According to embodiments of the cached data loading method and apparatus, the data is cached through the automatic loading information and the cache parameter information, so that system avalanche caused by large amounts of concurrent operations during cache failure is avoided; and furthermore, the cached data is sorted and a cache is judged, so that the utilization efficiency of the data in the cache and the reading efficiency of the cached data are improved.

Description

technical field [0001] This article involves but is not limited to data processing technology, especially a method and device for loading cached data. Background technique [0002] With the continuous expansion of the scale of the Internet and the growing number of Internet users, new requirements have been put forward for e-commerce websites. When a website is frequently visited by millions of users, the response speed of the system directly affects the user experience of visiting the website. [0003] One of the key technologies to improve website access speed by using caching technology. On many large websites, Redis has been widely used (Redis is an open-source, log-type, key-value (Key-Value) database written in C language of the American National Standards Institute (ANSI), supports the network, and can be memory-based or persistent. , and provide application programming interface (API) in multiple languages, memcached (Memcached is a high-performance distributed mem...

AI Technical Summary

Problems solved by technology

But at the same time, the memory cache technology is also limited by the physical memory size of the system. When the virtual memory function is enabled, if the memory is exhausted, the memory cache technology will store infrequently used data to the disk. This is determined by the memory cache technology. Yes, it is equivalent to the business layer handing over the cache exchange strategy to the memory cache technology, which lacks the flexibility of data caching to a certain extent; if the virtual memory function is disabled, the memory cache technology will use the virtual memory of the operating system, The business performance of websites involving cached data will drop sharply

Memory caching technology can also limit the physical memory that can be used through configuration options. When the upper threshold of memory usage is reached, even if a wrong write command prompt is given (but it will continue to accept self-read commands), if there are a large number of concurrent operations , will directly penetrate the cache to access the data in the data layer, resulting in an avalanche of the system

In addition, in related technologies, the cache hit rate of cached data is not high

[0004] To sum up, the current memory caching technology has the problem of system avalanche caused by a large number of concurrent operations when the cache fails

Images