Power marketing mass data processing method and system for smart power grid

Abstract

The invention discloses a power marketing mass data processing method for a smart power grid. The method comprises the following steps: firstly, performing integrated processing operations such as data extraction, conversion, correction and loading on marketing data in a data source layer; establishing a Hadoop-based distributed file system in a distributed cluster, wherein the distributed file system is used for transferring an intermediate calculation result and installing and configuring a Spark calculation framework, and the Spark calculation framework comprises a stream processing moduleused for real-time calculation and a batch processing module used for offline analysis; classifying the power marketing data through a marketing data decision tree algorithm, performing online / offlineprocessing analysis on the accumulated power marketing mass data according to the business requirements of the power enterprise, mining the hidden value of the power marketing data, and providing a decision analysis function for high-level managers of the power enterprise from the data level. According to the invention, the actual processing requirement of the power enterprise in an application occasion is met, and the processing efficiency and service expansibility of the power enterprise marketing system are improved.

Description

technical field [0001] The invention relates to the technical field related to data processing, in particular to a method and system for processing massive data of electric power marketing in a smart grid. Background technique [0002] Due to the rapid development of my country's electric power enterprises in recent years, the electric power industry has entered a critical period of market-oriented reform. Within the electric power enterprises, marketing is the focus and customer service is the basis. To respond to changing environments and different customers quickly and efficiently. In this data age, the combination of information communication system and smart grid has become a necessary way for efficient operation and management of power system. In the smart grid, the value of data can only be reflected by opening up the link between data and making it a whole. However, the computing platform of the existing power marketing system is very difficult in the exchange, proc...

AI Technical Summary

Problems solved by technology

[0005] For the smart grid, the data processing speed is very important. The larger the data volume, the longer the data processing time. If it exceeds the tolerance range of the current computing platform, it will have a negative impact on the operation of the smart grid, and even cause a partial grid failure.

Images