Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data source connection state monitoring device and method

A connection status and monitoring device technology, applied in hardware monitoring, multi-programming devices, structured data retrieval, etc., can solve the problems of system resource consumption, difficulty in realizing real-time and resource consumption, and inability to adjust, and avoid system resources. Waste, real-time and resource consumption effects

Active Publication Date: 2021-04-16
WUHAN DAMENG DATABASE
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has higher refresh efficiency, but it will put a lot of pressure on the system
[0007] It can be seen from this that it is difficult to achieve a balance between real-time performance and resource consumption in either the linear polling method or the concurrent method; in addition, the traditional monitoring technology needs to continuously monitor the connection status of a large number of different types of data sources, which cannot be based on The actual situation is adjusted, resulting in unnecessary consumption of system resources, resulting in waste of system memory and CPU resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data source connection state monitoring device and method
  • Data source connection state monitoring device and method
  • Data source connection state monitoring device and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] In order to solve the problems that the traditional monitoring technology needs to continuously test the connection of all data sources, which cannot be adjusted according to the actual situation, and it is difficult to achieve a balance between real-time performance and resource consumption, the embodiment of the present invention provides a data source connection state monitoring devices such as figure 1 As shown, it mainly includes two components, the data source status listener and the data source status manager.

[0056] The data source status listener is used to monitor the connection requests and refresh requests of multiple data source status monitoring clients, and schedule the work of the data source status manager according to the request, which is equivalent to the relationship between the data source status manager and the data source status manager. The source state monitors the transit structure between clients.

[0057] The data source state manager mai...

Embodiment 2

[0115] On the basis of the above-mentioned embodiment 1, the embodiment of the present invention also provides a data source connection state monitoring method, which is completed by using the data source connection state monitoring device described in embodiment 1, as figure 2 As shown, it mainly includes the following steps:

[0116] In step 10, the data source state manager creates a state refresh task for each type of data source in the ETL system, which is responsible for refreshing the connection state of the data source, and puts it into a delay queue for execution.

[0117] to combine figure 1 In the shown device, the data source status listener will monitor the connection requests of each data source status monitoring client in real time: whenever a data source status monitoring client sends a connection request, it will add 1 to the counter and send a message to all data source status monitoring clients. The start-stop device in the data source state manager sends ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data source connection state monitoring device and method. The device comprises a data source state monitor and a data source state manager. The data source state manager comprises a data source state warehouse, a start-stop device and a refreshing module; a plurality of state memories are arranged in the data source state warehouse, and each state memory stores the connection state of one type of data source; the start-stop device creates a state refreshing task for each type of data source and puts the state refreshing task into a delay queue; the refreshing module controls each state refreshing task in the queue to periodically refresh the data source connection state and update the data source connection state in the corresponding state memory; and when the monitor monitors a refreshing request of the data source state monitoring client, forwarding the data source connection state returned by the data source state warehouse to the data source state monitoring client. According to the scheme, the multi-data-source connection state is monitored on the premise that system resource consumption is reduced as much as possible, and balance between real-time performance and resource consumption is achieved.

Description

【Technical field】 [0001] The invention relates to the technical field of data monitoring, in particular to a data source connection state monitoring device and method. 【Background technique】 [0002] The data exchange system (hereinafter referred to as ETL) is a data processing system with the functions of data extraction (Extract), cleaning transformation (Transform) and data loading (Load). The data source object is the data exchange system when the data is read or written. External data that needs to be connected. The connection information of these data sources is stored in the form of metadata for the system to access at any time. In the data exchange system, users need to be able to easily check whether part or all of the data sources can be connected normally, or cause failures that cannot be connected in order to troubleshoot. Therefore, there needs to be a functional module in the system to monitor the connection status of the data source objects. Record and mainta...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06F16/21G06F16/25G06F9/48
Inventor 黄海明高东升胡高坤
Owner WUHAN DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com