Heterogeneous data real-time interaction optimal processing method

A heterogeneous data, real-time interactive technology, applied in the field of data processing, to achieve high data processing efficiency, improve data query efficiency, and shorten the time

Inactive Publication Date: 2018-09-07
CHONGQING UNIV
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a real-time interactive optimization processing method for heterogeneous data, which can solve the problem of real-time interactive processing of heterogeneous data and realize real-time sharing between data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous data real-time interaction optimal processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The present invention will be further described below in conjunction with drawings and embodiments.

[0034] A real-time interactive optimization processing method for heterogeneous data, the specific steps are as follows:

[0035] 1) Split heterogeneous data, use distributed storage to store data, and form new data sets;

[0036] The specific method for splitting heterogeneous data is as follows:

[0037] 1-1) Store data of different structures in different independent data sets according to the structure;

[0038] 1-2) Split each data set by horizontal partitioning.

[0039] The specific steps for horizontal partitioning are as follows:

[0040] 1-2-1) Delete the existing clustered index;

[0041] 1-2-2) Re-add the clustered index and specify the column to add the index;

[0042] 1-2-3) Create the column of the specified partition in the partition scheme;

[0043] 2) Create a heterogeneous index table;

[0044] The specific steps to create a heterogeneous index...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heterogeneous data real-time interaction optimal processing method. Heterogeneous data real-time interaction is realized by using the method of establishing a heterogeneous data index table. According to the method, heterogeneous data is split and stored in a distributed mode; keywords are extracted, and the heterogeneous data index table is constructed depending on a keyword count ordering strategy; the storage position of needed data is found through a hierarchical retrieval mode; and last, the needed data is obtained through a data summarization module and is returned to a client after the data format is converted into a needed data format, so that data interaction is realized. The method has rapidity and high efficiency, and due to splitting of the heterogeneous data, storage space is saved and data query speed is increased; and data query efficiency is greatly improved by use of index query.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for real-time interactive processing of heterogeneous data. Background technique [0002] In the process of enterprise information construction, a large number of functional applications are integrated into the enterprise information portal system, which need to be managed in a centralized and unified manner to meet the needs of shared data applications. However, there are many types of differences between a large number of functional applications, which are reflected in the development language, development platform, operating system, database management system, network communication protocol, etc. Among them, database differences are relatively prominent. Different system data sources and application requirements lead to differences in data structures. Due to the different methods of data access and data sharing in heterogeneous databases, real-time sharing bet...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 张可柴毅朱燕黄若山朱博
Owner CHONGQING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products