Construction method and device of multi-source heterogeneous SQL query engine

A construction method and query engine technology, applied in the field of multi-source heterogeneous data SQL query, can solve problems such as inability to meet and difficult to meet the needs of fast access query analysis

Inactive Publication Date: 2021-03-30
京信数据科技有限公司
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can be seen that the PrestoDB query engine cannot meet the flexible and compatible adaptation for different types of database sources in different business scenarios, so it is difficult to meet the fast access query analysis requirements of various data sources in the current big data scenario

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Construction method and device of multi-source heterogeneous SQL query engine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus their repeated descriptions will be omitted.

[0047]Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a construction method and device of a multi-source heterogeneous SQL query engine. The construction method of the query engine comprises the following steps: S1, analyzing metadata of a data source and loading a memory; S2, converting and packaging the SQL grammar corresponding to the data source to obtain a directed acyclic graph class SqlNode, and verifying the SqlNode according to the metadata; S3, cutting the SqlNode to obtain an abstract program Extrace, taking a root node of the SqlNode to form a to-be-executed Sql grammar, and then selecting a corresponding calculation engine; S4, generating java codes required by calculation engine rules on the basis of an abstract program Extrace, and loading the java codes into a memory container; and S5, traversing and optimizing the java code generated in the previous step, converting the java code into a class code, executing the class code, performing data encapsulation, and loading an obtained data result into amemory. According to the invention, the associated query analysis of multi-source heterogeneous data is realized, and the rapid access query analysis requirements of various data sources in a big datascene can be met.

Description

technical field [0001] The invention relates to multi-source heterogeneous data SQL query technology, in particular to a method and device for constructing a multi-source heterogeneous SQL query engine. Background technique [0002] The operation of existing mainstream databases requires database query, writing, and updating on the basis of the SQL syntax rules provided by each database. When it comes to the association of multiple different types of database tables for data query and analysis, the data needs to be migrated to the same database for association analysis, which brings a lot of inconvenience to data query and analysis. [0003] At present, R&D personnel need to query based on the SQL syntax provided by the original database to query different databases or cross-database queries. When cross-database association queries are involved, it is necessary to migrate and extract different databases in advance, store them in the same database, and then perform multi-tab...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/242G06F8/30
CPCG06F16/2433G06F8/315
Inventor 王济平黎刚汤克云周健雄高俊杰
Owner 京信数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products