Intelligent power distribution data conversion method based on big data platform

Abstract

The invention discloses a big data platform-based intelligent power distribution and utilization data conversion method. The method comprises the steps of integrating original data of power distribution and utilization business systems through a data interface, and storing the original data in a data cache region; migrating the original data of the business systems to an original library from the data cache region, thereby providing a data basis for subsequent data cleaning and analysis; processing the original data by virtue of a big data platform, storing the processed data in an intermediate library according to a new table structure, thereby serving as original data of subsequent data analysis; and migrating the analyzed data to a result library from the intermediate library, and creating a global index. The data is processed through the big data platform; raw data is converted into processed data meeting function demands of the intelligent power distribution and utilization business systems; the business data demands of intelligent power distribution and utilization application functions are met; the storage structure is optimized; and comprehensive intelligent and lean development of intelligent power distribution and utilization businesses is promoted.

Description

technical field [0001] The invention relates to an intelligent power distribution data conversion method based on a big data platform, and belongs to the technical field of electric power automation. Background technique [0002] With the continuous deepening of the construction of smart distribution grids, the number of collection terminals has increased sharply, and the frequency of collection has been greatly enhanced. The data volume of distribution and consumption has developed from TB level to PB level, facing the effective integration of multi-source heterogeneous massive data. , efficient storage and high scalability challenges. At the same time, the power distribution business is gradually developing in the direction of intelligence and leanness, and it is necessary to further improve cross-business and cross-platform data analysis and processing capabilities, so as to improve the efficiency of data storage and processing, the accuracy and real-time nature of value ...

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to overcome the deficiencies in the prior art and provide a method for converting intelligent power distribution and consumption data based on a big data platform to solve the problem of numerous data sources, inconsistent data formats, Technical problems with huge amount of data that cannot be directly used

Images