Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data query method, device and system

A data query and database technology, applied in the field of devices and systems, and data query methods, can solve the problem that multiple associated partition tables cannot support relational query and statistical functions, etc.

Active Publication Date: 2017-03-22
珠海多玩信息技术有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that some relational query and statistical functions cannot be supported for multiple associated partition tables, the embodiment of the present invention provides a data query method, device and system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data query method, device and system
  • Data query method, device and system
  • Data query method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0076] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0077] Please refer to figure 1 , which shows a schematic structural diagram of the implementation environment involved in the data query method provided by the embodiment of the present invention. The implementation environment includes a database cluster 120 , a parallel data warehouse tool Hive 140 connected to the database cluster 120 , and a parallel computing framework Hadoop 160 connected to the database cluster 120 . The parallel computing architecture Hadoop160 is also connected with the parallel data warehouse tool Hive140.

[0078] The database cluster 120 stores at least two associated partition tables and partition description information of these partition tables. Partition description information is used to describe th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data querying method, a data querying device and a data querying system and belongs to the field of data storage. The data querying method includes: acquiring an HQL (high order language) querying sentence aiming at a database cluster by a Hive, wherein an appointed Hive table in the HQL query sentence corresponds to at least two sheets of partition tables; generating a MapRedudce execution scheme according to the HQL querying sentence; sending the MapRedudce execution scheme to parallel computing framework Hadoop; receiving a querying result fed back by the Hadoop. The data querying method, the data querying device and the data querying system have the advantages that the problem that currently related querying and a statistical function cannot be supported by multiple associated partition tables, and distributed parallel computing characters of the Hive and the Hadoop are utilized to realize relational querying and the statistical function of multiple associated partition tables in a database cluster.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a data query method, device and system. Background technique [0002] MySQL database is a widely used database. With the exponential growth of data access pressure, the storage and query capabilities of a single MySQL database will increasingly become the bottleneck of the data system. [0003] At present, multiple MySQL databases are often used to form a database cluster to provide services together. After the table originally stored in a single MySQL is horizontally partitioned, it is stored in multiple partition tables of multiple MySQL databases, and each partition table stores the original table. Part of the data in the database to meet the storage needs of large-scale databases. [0004] In the process of realizing the present invention, the inventor found that the prior art has at least the following problems: for a single data table, various flexible query SQL statements are...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/24532G06F16/24542G06F16/283
Inventor 喻先兵
Owner 珠海多玩信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com