Energy data analysis system and method based on big data

Abstract

The technical field of data analysis of the present invention, in particular, relates to an energy data analysis system and method based on big data. The system includes: a data acquisition unit, including: various types of acquisition units deployed on site, and the acquisition unit is configured to collect raw energy data; a data storage unit: divides and classifies the collected raw energy data Storage, remove data redundancy; data preprocessing unit: check the integrity of data, remove noise and singular values, use data compression and transformation methods to reduce the number of effective variables or data samples to be considered according to the goal of the task, or Find the invariant identity of the data, and finally standardize the data. Through data segmentation and classification of energy data, it effectively reduces the redundancy of energy data and improves the efficiency of subsequent data processing; at the same time, it uses a deep learning model to conduct multi-scale analysis of energy data, improving the accuracy of data analysis results sex.

Description

technical field [0001] The invention belongs to the technical field of data analysis, and in particular relates to an energy data analysis system and method based on big data. Background technique [0002] Big data refers to the collection of data whose content cannot be captured, managed and processed by conventional software tools within a certain period of time. Big data technology refers to the ability to quickly obtain valuable information from various types of data. Technologies applicable to big data, including massively parallel processing (MPP) databases, data mining grids, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems. [0003] At present, the acquisition and integration of massive energy data is the basis for the construction of energy big data, but the problem of isolated information islands in the energy field has become an important restrictive factor in promoting the integration of energ...

AI Technical Summary

Problems solved by technology

On the one hand, in the informatization process of energy enterprises such as electric power, coal, oil, natural gas, cooling / heating, etc., due to the lack of an effective unified management mechanism, energy enterprises have multiple sets of independent energy management systems, through their respective sensors. Collect data from individual systems

However, due to the inconsistency of the system architectures and protocols, the data collected by each cannot be shared, which restricts the further analysis and mining of energy big data

On the other hand, traditional electric power and other energy systems have maintained their own planning, independent operation, and compartmentalization for a long time. The industry barriers between systems are serious, and the data standards and contents are inconsistent, which closes the information exchange between different energy systems. , the lack of coordination and cooperation between each other leads to the overall low efficiency of energy use, which is not conducive to the economical and efficient operation of the energy supply system, and the shortage of traditional fossil energy is becoming more and more serious, and environmental pollution problems are also emerging in an endless stream

Images