Data processing system based on big data platform, and link optimization method

A data processing system and big data platform technology, applied in the field of data processing, can solve problems such as waste of storage resources, repeated data storage, and inability to make good use of data storage components, so as to improve consistency and timeliness, and eliminate data redundancy. The rest of the effect

Active Publication Date: 2020-05-26
STATE GRID FUJIAN ELECTRIC POWER CO LTD
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are problems of scattered data storage and repeated data storage, resulting in waste of storage resources. Each applica

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing system based on big data platform, and link optimization method
  • Data processing system based on big data platform, and link optimization method
  • Data processing system based on big data platform, and link optimization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0075] The technical solution of the present invention will be specifically described below in conjunction with the accompanying drawings.

[0076] The invention provides a data processing system based on a big data platform, comprising:

[0077] The data access module is used to collect various types of power data, wherein the types of power data include: non-real-time structured data, collected measurement data and external data;

[0078] The data storage module is used to standardize and correlate various types of power data according to preset data processing rules, and classify and store the processed power data according to business application requirements;

[0079] The data calculation module is used to obtain the corresponding target power data from the data storage module according to the business application requirements, and calculate the target power data through the offline data calculation component or the real-time data calculation component to obtain the calcu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data processing system based on a big data platform, and a link optimization method. The system comprises: a data access module used for collecting electric power data of each category, wherein the categories of the electric power data comprise non-real-time structured data, collected measurement data and external data; a data storage module for carrying out standardization processing and association processing on the electric power data of each category according to a preset data processing rule, and carrying out classified storage on the processed electric power data according to business application requirements; a data calculation module for acquiring corresponding target power data from the data storage module according to business application requirements and calculating the target power data through an offline data calculation assembly or a real-time data calculation assembly to obtain a calculation result; and an analysis service module for acquiringthe calculation result, analyzing the calculation result and outputting an analysis result according to a preset output form. According to the system, data redundancy can be eliminated, and cross-professional data consistency and timeliness are improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, and more specifically, to a data processing system and link optimization method based on a big data platform. Background technique [0002] With the continuous development of informatization, each business system, data center, and big data platform are independently constructed. The specific data links are as follows: figure 1 mentioned. According to different data requirements, each application scenario extracts the data required by itself, and then performs calculations to realize data application display. However, there are problems of scattered data storage and repeated data storage, resulting in waste of storage resources. Each application scenario is calculated separately, which cannot make good use of the data storage components of the established big data platform. Contents of the invention [0003] The purpose of the present invention is to provide a data processing s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F16/27G06F16/2455G06F16/28
CPCG06F16/25G06F16/254G06F16/275G06F16/24552G06F16/285
Inventor 陈红付婷王雪晶方志坚颜伟琼王维兰孙浩淞李金湖林翰
Owner STATE GRID FUJIAN ELECTRIC POWER CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap