A data query method, device, terminal, presto query engine and storage medium

A technology of data query and query engine, applied in the field of data query, to achieve the effect of improving data query efficiency, ensuring real-time and comprehensiveness

Active Publication Date: 2021-05-28
亿度慧达教育科技(北京)有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, as the amount of data stored in the data source increases, data query using presto also faces challenges, for example, how to further improve the efficiency of data query

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data query method, device, terminal, presto query engine and storage medium
  • A data query method, device, terminal, presto query engine and storage medium
  • A data query method, device, terminal, presto query engine and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The data of the data source connected by presto is continuously generated. For example, the buried point (a data collection technology) will continuously collect data and store it in the data source; therefore, when performing data query, it is necessary to ensure the real-time query results The comprehensiveness of the query results must also be guaranteed, which puts forward further requirements on the query efficiency of using presto to query data.

[0042] Based on this, the embodiment of the present invention utilizes the ability of presto to connect to multiple data sources, and sets up presto to connect the first data source and the second data source. The first data source and the second data source can be any two different data sources docked by presto Data source, as a kind of example, the first data source can comprise kafka data source, and the second data source can comprise hive (hive is a kind of data warehouse tool based on hadoop) data source;

[0043] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present invention provide a data query method, device, terminal, presto query engine, and storage medium. The method includes: obtaining query conditions, which include query fields and query time periods; Within the time period, the query time period is divided into the first time period within the predetermined time from the current time, and the second time period beyond the predetermined time from the current time; according to the first time period and the query field, generate the query first data source The first request, and according to the second time period and query field, generate a second request to query the second data source; combine the first request and the second request to generate a target query request; submit the target query request to the presto query engine. The embodiments of the present invention can facilitate the query division of the first data source and the second data source by the presto query engine to be more efficient and accurate, and provide the possibility to improve the efficiency of data query while ensuring the real-time and comprehensiveness of the query results .

Description

technical field [0001] Embodiments of the present invention relate to the technical field of data query, and in particular to a data query method, device, terminal, presto query engine, and storage medium. Background technique [0002] Presto is an open source distributed SQL (Structured Query Language) query engine, and its query speed can reach the level of commercial data warehouses. Using the performance of presto to realize data query in data sources will undoubtedly improve the efficiency of data query better solution. [0003] However, as the amount of data stored in the data source increases, data query using presto also faces challenges, for example, how to further improve the efficiency of data query. Contents of the invention [0004] In view of this, embodiments of the present invention provide a data query method, device, terminal, presto query engine, and storage medium, so as to further improve data query efficiency. [0005] In order to achieve the above ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2458G06F16/28
Inventor 朱顺利杨茹越
Owner 亿度慧达教育科技(北京)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap