Compression method serving industrial interconnection data acquisition and storage

Abstract

The invention discloses a compression method serving industrial interconnection data acquisition and storage. The method belongs to the field of data compression, and comprises the following steps: S1, defining a range value, a range percentage, a longest interval and a shortest interval on a platform, S2, carrying out analysis processing according to a process of judging the longest interval, carrying out range calculation and judging the shortest interval, and S3, storing data subjected to the processing process. According to the method, dynamic configuration is achieved technically, the compression hit rate is increased reasonably, screening of feature data is refined, the operand is reduced to the minimum standard, and it is guaranteed that the operation efficiency is the highest; resource controllability is economically achieved, free configuration is achieved according to requirements, and rationality and integrity of data are considered while resource use is reduced as much as possible; dynamic adaptation is achieved in performance, horizontal expansion is achieved through a distributed architecture, dynamic adaptation is conducted according to different data scales, and thecollection and storage performance is greatly improved.

Description

technical field [0001] The invention relates to the field of data compression, in particular to a compression method serving industrial interconnection data collection and storage. Background technique [0002] Data compression is basically squeezing data so that it takes up less disk storage space and a shorter transfer time. The basis of compression is that the digital data contains a large number of repetitions, and it replaces these repeated information with symbols or codes that occupy less space to achieve the purpose of reducing capacity. [0003] CN201610785231.7 An industrial process-based big data compression method, which relates to the technical field of industrial big data analysis. The invention compresses the collected production data by data blocks and collected data items, and processes the collected data of floating point type, Boolean type and character type respectively according to the type of the collected data items, so as to determine the fluctuation...

AI Technical Summary

Problems solved by technology

[0005] However, the existing compression methods have some defects when performing large-scale data compression on the platform, the compression hit rate is low, the dynamic compression of the calculation amount cannot be guaranteed, and the compression scale is limited.

Images