Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Control method, device and equipment of data acquisition task

A collection task and data collection technology, applied in the computer field, can solve problems such as waste of resources and achieve the effect of reducing waste of resources

Inactive Publication Date: 2018-05-08
北京中关村科金技术有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to disclose a control method, device and equipment for data collection tasks, which solves the problem of waste of resources caused by invalid data collection tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Control method, device and equipment of data acquisition task
  • Control method, device and equipment of data acquisition task
  • Control method, device and equipment of data acquisition task

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0043] The embodiment of the invention discloses a data collection task control method, device and equipment, which solves the resource waste problem caused by invalid data collection tasks.

[0044] See figure 1 , figure 1 It is a schematic flowchart of a control method for a data collection task disclosed in an embodiment of the present invention, as shown in figure 1 shown, including:

[0045] S101. Obtain target data corresponding to the data collection...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a control method of a data acquisition task. The control method comprises the steps of firstly obtaining target data corresponding to the data acquisition task, then judging whether or not the target data is in a threshold value range, and if not, using the data acquisition task as an abnormal data acquisition task and pausing the abnormal data acquisition task. Thus, aiming at each data acquisition task, the target data generated by the data acquisition task is obtained in real time, whether the target data is within the threshold value range or not is further judged,accordingly, whether the data acquisition task corresponding to the target data is the abnormal data acquisition task or not is detected, after the abnormal data acquisition task is detected, the abnormal data acquisition task is paused, the problem that when the data acquisition task is abnormal and cannot be effectively processed, system resources or storage resources are occupied is solved, andresource waste is reduced. The invention further discloses a control device and equipment of the data acquisition task. The control device and equipment also have the advantages.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a control method, device and equipment for a data collection task. Background technique [0002] With the development of science and technology, the information age has gradually become a topic of discussion. When users visit major websites, use Internet search engine technology or crawler technology to achieve targeted and accurate data capture, that is, to collect website data. [0003] As more and more users use the Internet, the demand for web page data collection has also doubled. Therefore, the concurrent task processing capability and stable operation of the data collection system pose a great challenge. For different websites, different users Data collection tasks need to be executed concurrently in a data collection system, which requires direct and reasonable allocation of computing and storage resources in the system for different tasks, so as to obtain valuable dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F9/50
CPCG06F9/5016G06F16/958
Inventor 马铭远李界鹏王能
Owner 北京中关村科金技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com