Data storage and retrieval method and device for heterogeneous data source

A heterogeneous data source and data storage technology, which is applied in the data storage and data retrieval fields of heterogeneous data sources, can solve the problems of unfavorable maintenance management and high development costs, and achieve the benefits of follow-up maintenance management, reduced processing costs, and high efficiency Effect

Pending Publication Date: 2022-04-08
BEIJING QIANXIN TECH +1
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this has extremely high requirements on program performance and reliability, which is equivalent to the need for customized development, resulting in high development costs and is not conducive to subsequent maintenance management

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage and retrieval method and device for heterogeneous data source
  • Data storage and retrieval method and device for heterogeneous data source
  • Data storage and retrieval method and device for heterogeneous data source

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.

[0080] The embodiment of the present invention provides a data storage method for heterogeneous data sources, such as figure 1 As shown, the method realizes the acquisition and storage functions in a general manner for different heterogeneous data sources, and the embodiment of the present invention provides the following specific steps:

[0081] 101. Receive a data collection instruction, where the data collection instruction includes an ident...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method and device and a data retrieval method and device for a heterogeneous data source, relates to the technical field of heterogeneous data source processing, and aims to optimize the collection, storage and retrieval operations of the heterogeneous data source, reduce the processing cost, improve the processing efficiency and facilitate subsequent maintenance and management. According to the main technical scheme, the method comprises the following steps: receiving a data acquisition instruction, wherein the data acquisition instruction comprises an identifier of a heterogeneous data source; based on the identifier of the heterogeneous data source, searching the corresponding heterogeneous data source, in which an annotation is embedded, and the annotation is used for configuring a data acquisition mode of the heterogeneous data source; according to the annotation embedded in the heterogeneous data source, executing data acquisition operation to obtain target data; and storing the target data into a column storage database by utilizing a preset configuration file, so as to provide a retrieval operation on a heterogeneous data source by utilizing the column storage database.

Description

technical field [0001] The present invention relates to the technical field of heterogeneous data source processing, in particular to a data storage and data retrieval method and device for heterogeneous data sources. Background technique [0002] The data retrieval operation can span multiple data sources. The data source is the source of the data. Different data sources contain a large amount of data (for example, log data) generated by business activities in various industries. These sources are different. Data will have differences in data structure, storage format, etc., forming a heterogeneous data source. The amount of data it contains is huge, and it can be tens of billions. [0003] At present, it is usually necessary to write customized scripts for each data source to realize the functions of data analysis and collection of required data, as well as to store the collected data and provide external retrieval capabilities. However, this has extremely high requiremen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/245G06F16/25G06F16/2457
Inventor 高羽
Owner BEIJING QIANXIN TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap