A data processing system based on cloud computing

Abstract

The invention discloses a data processing system based on cloud computation. The data processing system comprises a data acquisition unit, a cloud computation unit, a user terminal, an administrator terminal and a backup server, the data acquisition unit is used for acquiring data of large-scale perception source data streams, the cloud computation unit is used for receiving, processing and storing the data of the data acquisition unit, and the backup server is used for data backup. According to the system, the acquired data are processed by a data processing server, the data processed by a node are filtered, data processing expense is reduced, so that data processing is localized, data transmission expense between nodes is reduced, storage energy consumption is reduced, three-layer data storage of acquired data is performed by the aid of a database server according to the advantages of heterogeneity, indeterminacy, high data stream and the like of acquired mass data in cloud computation, expandability and fault tolerance of data storage are improved, and the data processing system is applicable to data acquisition requirements of different users and wide in application range and has high applicability.

Description

technical field [0001] The invention belongs to the technical field of data processing systems, and in particular relates to a data processing system based on cloud computing. Background technique [0002] With the development of computer technology and society, the whole world is in a very huge data group. The traditional data processing mode is to use a mainframe with strong processing capability and a relational database, and store all of it on a mainframe with a large disk capacity. Although the storage capacity of the disk has been increasing in recent years, its access speed However, they failed to keep pace with the times, so various database vendors had to develop a new generation of databases to meet the challenges of big data. Considering issues such as capacity and parallel processing, some experts proposed to use distributed technology to build a distributed database, and use cluster mode to store massive data. Cloud computing technology has a good application h...

AI Technical Summary

Problems solved by technology

[0003] The data processed in the cloud computing environment is different from traditional data. A large amount of data collected in cloud computing has the characteristics of heterogeneity, uncertainty, and high data flow. In the data processing system based on cloud computing, the data storage can be There are certain problems in terms of scalability, fault tolerance, and storage energy consumption. At the same time, with the rapid increase in the number of users, due to the increasing number of different needs of different users in different industries, various big data resources continue to expand the resource library. , how to deal with the increasing data requests on the network and other issues is the current challenge of data processing

Images