Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data query method and related device

A data query and data technology, applied in the field of data query, can solve problems such as inability to meet application requirements and data query difficulties, and achieve the effects of direct and efficient data query, lightweight related operations, and improved data query speed.

Pending Publication Date: 2021-05-04
BEIJING GRIDSUM TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the inventor found through research that with the rapid growth of the data volume of crawler data, data query is performed directly in the database storing large-scale crawler data based on query conditions, and data query becomes more and more difficult, and the speed of data query is limited. If there is a large negative impact, data query cannot be realized directly and efficiently, and thus cannot meet the application requirements of real-time data query in actual business scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data query method and related device
  • Data query method and related device
  • Data query method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0041] At present, the real-time crawler of the system obtains a large amount of crawler data. In a certain business scenario, the system user directly configures the query conditions according to the business scenario, and directly...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data query method and a related device. The method comprises steps that a target program receives crawler data in real time; and based on the target query condition and a pre-constructed computer language representing the query statement, the crawler data in the target program is screened to obtain target data. It can be seen that the mode of screening the crawler data received in real time by using the target query condition and the pre-constructed computer language representing the query statement in the target program is used for replacing the mode of directly querying the database based on the target query condition, and the crawler data meeting the target query condition is obtained through screening to serve as the target data; the data query pressure acts on the target program, and the data query pressure of the database is released, so the related operation of the database is lighter, the data query speed of large-data-volume crawler data is improved, direct and efficient data query of the large-data-volume crawler data is realized, and the application requirement of real-time data query in an actual service scene is met.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a data query method and a related device. Background technique [0002] With the rapid development of the network, crawler technology came into being. In current business scenarios, based on different business scenarios and scopes of use, it is necessary to perform data query operations of different dimensions and data volumes on the crawler data obtained using crawler technology. For example, the real-time crawler of the system obtains a large amount of crawler data, but in a certain business scenario, the system user only needs to query the data related to the business scenario. [0003] Generally, system users query data related to specific business scenarios. Specifically, system users directly configure query conditions according to specific business scenarios. Data, that is, to obtain data related to that particular business scenario. [0004] However, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/951G06F16/25
CPCG06F16/951G06F16/25
Inventor 袁园
Owner BEIJING GRIDSUM TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products