Data management device and method

Abstract

The invention discloses a data management device, comprising: a data mirroring management unit, a high-speed data distribution unit, a data cache unit, a data permanent storage unit and the like. The data mirroring management unit is used to receive and distribute massive data access requests, and to query and judge the existence of data; the data high-speed distribution unit is used to calculate and provide the shortest data transmission path to end users; the data cache unit is used to speed up data reading and writing speed, and cache the result data processed by the data processing unit; the data permanent storage unit is used to permanently store the data obtained by the data mirror management unit from the external customer data system, and provide the data management device with original form data. The invention greatly reduces the request pressure of the data permanent storage unit and the data processing unit, accesses and processes the data in the customer-defined unit in a completely non-invasive manner, and gradually reduces until completely eliminating the dependence on the customer data system.

Description

technical field [0001] The present invention relates to a cloud computing technology, in particular to a data management device and method. Background technique [0002] After nearly 20 years of development, Internet technology is now very mature, and with the rapid popularization of mobile devices, especially smart phones, the threshold for data generation has dropped in recent years, and the total amount of data in the whole society has increased rapidly. In 2011, the total amount of data in the world has reached 1800EB, and it is expected to reach 7900EB in 2015, maintaining the speed of doubling every two years. [0003] With the rapid increase of the total amount of data, the society's demand for cloud storage services is becoming stronger and stronger. Cloud storage services can manage massive amounts of data at a low unit storage cost, and will not lead to a gradual decline in access performance as the amount of data grows. [0004] For enterprises that have adopted...

AI Technical Summary

Problems solved by technology

However, the content distribution network cannot completely break away from the dependence on the source data system, so it cannot achieve very wide universality

[0006] The three major problems of storage, access, and processing of massive data usually appear at the same time, and only solving one or two of them cannot solve complex data management technical problems

With the rapid increase in the amount of data, the original data processing infrastructure has become unusable. When the number of user visits increases frequently, the data processing system is often unresponsive and unable to respond to user access to data in a timely manner.

Images