Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed automatic collecting method

A distributed and program acquisition technology, applied in the direction of hardware monitoring, etc.

Inactive Publication Date: 2015-06-17
INSPUR GROUP CO LTD
View PDF8 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005]1) Large amount of maintenance, remote connection, repetitive configuration, collection, etc.
[0006]2) Server resources are wasted, each server resource cannot be fully utilized, and the next step of the program cannot be executed in time because the manual cannot find whether the server collection is completed in time
[0007]3) The error rate increases, because a lot of manual operations are required, the error rate of configuration information will also increase
[0008]4) The amount of data is large, and the collection types and configurations are different

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed automatic collecting method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] The steps of this method are as follows:

[0024] Step 1: Deploy the stand-alone acquisition program to each server;

[0025] Step 2: Use one of the servers as the management server to control other servers, and configure the addresses of other servers;

[0026] Step 3: Put the addresses to be collected into the management server database, and the management server will assign tasks according to the collection speed of each server;

[0027] Step 4: The management server operates the collection program of the collection server through crawler technology, what type of data to collect, when to collect, and when to end are all controlled by the management server;

[0028] Step 5: Configure the work collected at a fixed time every month into the database of the management server, and set a scheduled task;

[0029] Step 6: By monitoring the server system, judge the collection situation of the server, send the abnormally collected server information to the administra...

Embodiment 2

[0031] Each collection task is different, the collection time is different, and the address of the child node changes; build the platform through the following steps:

[0032] 1) Deploy the stand-alone collection program to the child nodes and start the collection program.

[0033] 2) Configure the address of the collection node on the management server and pass the test.

[0034] 3) Call the interface of the monitoring server system.

[0035] 4) Deploy data nodes.

[0036] 5) Configure the collection task and pass the test.

[0037] Manage the single-machine collection programs deployed on multiple servers in a unified manner, and assign and receive collection tasks by sending / receiving messages. Balance the collection pressure of each server, and transfer the load from a single node to multiple nodes, thereby improving efficiency. The danger of the entire system crashing due to the failure of a single node can be avoided. Human maintenance is reduced, the configured col...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed automatic collecting method. The method comprises the following steps that a single-unit collecting procedure is allocated to all servers; one server serves as a management server controlling other servers, and addresses of other servers are configured; addresses to be collected are placed in a management server database, and task allocation is carried out; the management server operates a collecting procedure of a collecting server through the crawler technology, and the type of data to be collected is controlled through the management server; the collecting work carried out at fixed time in each month is allocated to the management server database, and timing tasks are set; a server monitoring system is used for judging the collecting situation of the servers, abnormally collected server information is sent to an administrator, and collecting tasks are evenly allocated to other idle servers. According to the distributed automatic collecting method, the danger of the collapse of the whole system can be avoided, manpower maintenance is reduced, and the server monitoring system is used for judging the collecting situation of child nodes.

Description

technical field [0001] The present invention relates to the technical field of computer data processing, specifically a distributed automatic collection method. Background technique [0002] In reality, a large amount of data is generated all the time, some need to be analyzed, some need to be stored, all these data that need to be processed are huge and similar, so it is necessary to analyze and process these big data and extract the required data. [0003] Data collection requires data to be similar, so that corresponding data can be extracted according to their laws, and the collected data must also have the value or use of collection and extraction. Data collection must have a collection method or plan, can be collected with plans and steps, and must have collection conditions, such as equipment and technology. [0004] Faced with dozens or hundreds of servers, if the collection personnel have to enter the server to configure collection tasks and operate the collection...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30
Inventor 孙海峰王传超徐宏伟
Owner INSPUR GROUP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com