Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Mass unstructured distribution network data integration method based on knowledge mapping technology

An unstructured, knowledge graph technology, applied in the field of data fusion and integration, can solve the problems of slow integration, unfavorable classification and storage of massive data, and large amount of data center cleaning, so as to optimize data integration and reduce the amount of data fusion calculation. Effect

Active Publication Date: 2017-11-07
YUNNAN POWER GRID CO LTD ELECTRIC POWER RES INST
View PDF6 Cites 48 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, on the one hand, this method generally performs centralized data cleaning in the data center, resulting in a large amount of data cleaning and slow integration speed, which cannot meet the integration requirements of massive unstructured data; on the other hand, the unstructured data of each information system There are differences in business logic, data format, and storage of digitalized data. Therefore, when the data is transmitted to the data center platform, it is not only not conducive to the classified storage of massive data, but also brings inconvenience to data extraction and query, which greatly increases the data center. workload of the platform

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass unstructured distribution network data integration method based on knowledge mapping technology
  • Mass unstructured distribution network data integration method based on knowledge mapping technology
  • Mass unstructured distribution network data integration method based on knowledge mapping technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings.

[0069] like figure 1 As shown, it is a flow chart of the construction of a distributed multi-source heterogeneous data index shown in an embodiment of the present invention, including multiple information systems, such as smart meters, SCADA (Supervisory Control And Data Acquisition, power distribution data acquisition and monitoring) system, marketing system and production system, among which, each information system is equipped with a data acquisition unit and a big data connector, and the data acquisition unit is used to collect and quality analyze the unstructured distribution network data of each information system And data cleaning, to find and correct identifiable errors in the data, inc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a mass unstructured distribution network data integration method based on knowledge mapping technology. The method includes that a data collection unit collects unstructured distribution network data of each informatization system, and quality analysis and data cleaning processing are performed on the unstructured distribution network data of each informatization system; according to the processed unstructured distribution network data of each informatization system, data local index based on local knowledge mapping is constructed; the data local index based on the local knowledge mapping is sent to a data management center through a big data connector; the data management center constructs data global index based on global knowledge mapping. Collection, quality analysis and data cleaning of distributed multi-source heterogeneous data are advanced to each informatization system, so that data fusion calculation quantity, storage pressure and data scheduling burden of the data management center are lowered; the data global index based on the global knowledge mapping is utilized to integrate data sources, so that convenience is brought to data inquiry and extraction, and workload of the data management center is reduced.

Description

technical field [0001] The invention relates to the technical field of data fusion and integration, in particular to a massive unstructured distribution network data integration method based on knowledge map technology. Background technique [0002] The power grid includes information systems such as marketing systems, production systems, distribution data collection and monitoring systems, and energy meters. Massive data, combined with business system data such as marketing system and production system, and effectively identify and filter the data, finally output relevant data that is beneficial to power operation and improves customer service quality and service level. [0003] The distribution network data collected from various information systems can be divided into two types, one is structured data, such as data or symbol data, and the other is unstructured data, such as user voice, image, text, etc. The existing unstructured distribution network data integration meth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/316G06F16/367
Inventor 曹敏邹京希唐立军赵旭周年荣魏玲沈鑫
Owner YUNNAN POWER GRID CO LTD ELECTRIC POWER RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products