Data integration method and device

A data integration and data collection technology, applied in the field of big data processing, can solve the problems of reducing data processing efficiency, increasing the burden on users and enterprises, and failing to meet the scale of big data, so as to achieve the effect of improving reusability

Active Publication Date: 2020-03-17
CHONGQING JIANXI LARGE DATA SCI & TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This not only increases the burden on users and enterprises, reduces the efficiency of data processing, but also cannot meet the needs of large-scale data
In other words, the current data integration scheme has a big bottleneck in terms of user usage and big data expansion performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data integration method and device
  • Data integration method and device
  • Data integration method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Various exemplary embodiments, features, and aspects of the invention will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures indicate functionally identical or similar elements. While various aspects of the embodiments are shown in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

[0031] The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as superior or better than other embodiments.

[0032] In addition, in order to better illustrate the present invention, numerous specific details are given in the specific embodiments below. It will be understood by those skilled in the art that the present invention may be practiced without certain of the specific details. In some instances, methods, means, components and circuits well kn...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to a data integration method and apparatus, which are used for abstracting a data integration process into a data processing flowline. The data processing flowline can be realized by the following steps included in the data integration method: selecting each to-be-processed data element that needs data integration from a data set; performing a matching process on each to-be-processed data element to determine matching relationships between to-be-processed data elements; taking each selected to-be-processed data element as each vertex of a data relationship diagram; according to the matching relationships between the to-be-processed data elements, generating edges for connecting vertexes to obtain the data relationship diagram; and according to the data relationship diagram and a global decision, determining a to-be-modified data element from each vertex. The data elements in the data set are shown in the form of the data relationship diagram. A data mining analysis is performed based on the generated data relationship diagram. The data integration method and apparatus provided by the present invention can improve the efficiency and quality of data integration.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to a data integration method and device. Background technique [0002] Enterprise data analysis mainly includes three stages: data collection (Data Collection), data integration (Data Curation) and data analysis (Data Analytics). Among them, data collection refers to the collection, modeling and storage of data generated by various businesses; data integration refers to the screening, cleaning, deduplication and multi-data source integration of various data sources collected by enterprises, and finally according to Business data analysis needs to present the result as a new data source for downstream analysis. Here, the new data can come from one data source (such as a single data table) or multiple data sources (such as multiple different data table); data analysis means that the enterprise makes corresponding business analysis reports and forecast evaluations for the new data i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/28
CPCG06F16/284
Inventor 尹思
Owner CHONGQING JIANXI LARGE DATA SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap