Big data storage system

Abstract

The invention discloses a big data storage system, which comprises a target data acquisition module for acquiring target data through multiple ports and sending the acquired data to a data preprocessing module; the data preprocessing module is used for clearing redundant data on the basis of an ISODATA algorithm; the data feature extraction module is used for extracting feature data of the targetdata by adopting an attribute reduction algorithm based on attribute importance; the data classification module is used for realizing classification of target data according to the feature data basedon a naive Bayes classification algorithm; and the data positioning module is used for finding a proper position in the database for the target data in the database according to the classification result of the data classification module, finding similar data points for the target data, and establishing a relationship between the target data and the similar data points. According to the invention,while automatic arrangement and storage of big data can be realized, numerous and diverse mass data can be converted into available data with information and commercial value.

Description

technical field [0001] The invention relates to the field of big data, in particular to a big data storage system. Background technique [0002] With the explosive growth and accumulation of information, the era of big data is approaching. The basic characteristics of big data are: large data volume, various types, low value density, fast speed and high timeliness; for big data, correlation is more important than causality. More importantly, this is the conclusion of the era of big data. In the face of massive amounts of information, how to analyze the correlation between certain types of information and analyze the hidden value behind the information can reflect the data at a higher and deeper level. The value of information, but in the face of such a massive amount of data, it is very difficult to quickly and accurately analyze the relationship between the data. [0003] At present, the traditional data storage system generally has the disadvantages of single function and...

AI Technical Summary

Problems solved by technology

[0002] With the explosive growth and accumulation of information, the era of big data is approaching. The basic characteristics of big data are: large data volume, various types, low value density, fast speed and high timeliness; for big data, correlation is more important than causality. More importantly, this is the conclusion of the era of big data. In the face of massive amounts of information, how to analyze the correlation between certain types of information and analyze the hidden value behind the information can reflect the data at a higher and deeper level. The value of information, but in the face of such a massive amount of data, it is very difficult to quickly and accurately analyze the relationship between the data

[0003] At present, the traditional data storage system generally has the disadvantages of single function and the need to manually mine and classify the value of data in the later stage.

Images