Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and device for data parallel query acceleration based on high-frequency data processing

A high-frequency data and data technology, applied in the field of big data processing, can solve problems such as the reduction of query efficiency of data parallel processing capability, and achieve the effect of improving big data processing capability, reducing impact, and improving response speed.

Active Publication Date: 2022-02-22
BORRUI DATA TECH (BEIJING) CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a method for accelerating data parallel query based on high-frequency data processing to solve the technical problem in the prior art that data parallel processing capability and query efficiency are reduced due to data growth. The method includes:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for data parallel query acceleration based on high-frequency data processing
  • A method and device for data parallel query acceleration based on high-frequency data processing
  • A method and device for data parallel query acceleration based on high-frequency data processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0061] As mentioned in the background art, in the prior art, data parallel processing capability and query efficiency are reduced due to data growth.

[0062] The embodiment of the present invention proposes a method for accelerating data parallel query based on high-frequency data processing. The first master node receives the data query request sent by the user, and the query request carries query conditions; the first master node according to the The data query request generates an execu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and device for accelerating data parallel query based on high-frequency data processing. The method includes: a first master node receives a data query request sent by a user, and the query request carries query conditions; the first master node The node generates an execution plan according to the data query request, and queries each of the first-type data nodes according to the execution plan; if there is a matching data block matching the query condition in each of the first-type data nodes, the The first master node returns the result data to the user, and the result data is determined according to the merging result of each matching data block; wherein, the high-frequency data is that the access frequency is higher than that of the first master node Data with a preset frequency threshold, thereby improving the parallel processing capability of big data and the efficiency of query.

Description

technical field [0001] The present application relates to the technical field of big data processing, and more specifically, to a method and device for accelerating data parallel query based on high-frequency data processing. Background technique [0002] Large-scale static data refers to a collection of data with a certain amount of data, which can provide support for accurate decision-making. It is the product of the rise and popularization of the Internet and terminal smart devices. There are also different levels of data volume, such as TB level, PB level or ZB level. . In the era of big data, its data volume is still increasing rapidly. In order to meet this large-scale data storage and processing requirements, distributed systems are widely used in the industry at present, and data is stored in multiple independent data nodes (server devices). At the same time, on this basis, the introduction of full-memory computing technology realizes that the memory can process da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2453G06F16/2455G06F16/2458
CPCG06F16/2471G06F16/24532G06F16/24553G06F16/24554
Inventor 刘睿民
Owner BORRUI DATA TECH (BEIJING) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com