Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Log data query method and device

A query method and log technology, which is applied in the field of data processing, can solve problems such as slow query speed, and achieve the effect of reducing waste and speeding up query speed

Active Publication Date: 2022-03-01
北京安帝科技有限公司
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a query method and device for log data, which is used to solve the defect of slow query speed in the prior art, realize reasonable setting of the number of storage nodes and allocation of computing resources, thereby increasing the query speed and reducing the waste of computing resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data query method and device
  • Log data query method and device
  • Log data query method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the present invention. Obviously, the described embodiments are part of the embodiments of the present invention , but not all examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0043] For ease of understanding, the terms involved in the present invention will be described first.

[0044] (1) Distributed storage system

[0045] For non-distributed storage systems, a large amount of data and a large amount of access will lead to input and output (IO) bottlenecks. Distributed storage stores a complete data set into different nodes by sharding, and each node can provi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a log data query method and device. The query method comprises the steps that a query statement of log data is acquired, and data attributes and storage addresses of the log data included in the query statement are analyzed; determining a storage node of the log data and a data storage amount corresponding to the storage node according to the storage address; configuring calculation power corresponding to the data storage amount for the storage node; and querying and obtaining log data corresponding to the data attributes in the storage address based on the calculation power. According to the data storage amount corresponding to the storage node, the appropriate computing power is allocated to the storage node, more computing resources are allocated to the storage node needing more computing power, and the query speed is increased. In addition, limiting items such as corresponding log data generation time, types and storage addresses are added in the query statements, so that a small query range can be conveniently locked according to the limiting items, the number of logs to be queried is reduced, and the query speed is increased.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a log data query method and device. Background technique [0002] Due to the large amount of log message data generated by tobacco manufacturers, a non-relational database (not only SQL, NOSQL) is used as a storage method. Usually, by deploying a storage server cluster, the log message data is stored centrally using a multi-node, multi-partition storage method, that is, a distributed storage system is used to centrally store the log message data. When performing structured query language (SQL) query on logs, SQL query statements can also be used to directly query multi-node and multi-partition log message data. [0003] When using the storage method corresponding to the distributed storage system in the prior art to store log message data, all storage nodes need to be traversed to obtain the query data, so there is a disadvantage of slow query speed. Contents of the in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/242G06F16/27
CPCG06F16/2433G06F16/27
Inventor 周磊姜双林饶志波王晓辉
Owner 北京安帝科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com