Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data monitoring method and device

A data monitoring method and data technology, applied in the field of data management, can solve the problems of high implementation cost and low efficiency

Pending Publication Date: 2020-04-03
深圳博沃智慧科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Such an implementation is very costly and inefficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data monitoring method and device
  • Data monitoring method and device
  • Data monitoring method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0050] like figure 1 As shown, the data monitoring method of the present application, an implementation thereof, includes the following steps:

[0051] Step 102: Use ETL to collect data in the task.

[0052] Step 104: Encapsulate the data to be monitored among the data in the task as monitoring objects.

[0053] The monitoring objects include databases, database tables, database views, sql statements and / or java statements that return the quantity, and the like.

[0054] Step 106: Allocate system resources and continuously monitor the monitoring objects.

[0055] Step 108: Calculate the monitoring object, and store the monitoring result in the buffer.

[0056] The monitoring results are stored in the cache area, and the time to save the historical data can be determined according to the configuration. The generated monitoring result data is used as the basic supporting data for data early warning and asset map.

[0057] In one embodiment, the data monitoring method of the...

Embodiment 2

[0082] like image 3 As shown, the data monitoring device of the present application, an implementation manner thereof, includes a collection module 310 , a packaging module 320 , a monitoring module 330 and a processing module 340 .

[0083] The collection module 310 is configured to use ETL to collect data in the task. The encapsulation module 320 is configured to encapsulate the data to be monitored among the data in the task as a monitoring object. The monitoring objects include databases, database tables, database views, sql statements and / or java statements that return the quantity, and the like. The monitoring module 330 is configured to allocate system resources and continuously monitor the monitoring objects. The processing module 340 is configured to calculate the monitoring object and store the monitoring result in a cache area. The monitoring results are stored in the cache area, and the time to save the historical data can be determined according to the configu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data monitoring method and device. The method comprises the steps of: collecting data by using an ETL; packaging data needing to be monitored in the data into a monitoring object; allocating system resources, and continuously monitoring the monitored object; and calculating the monitoring object, and storing a monitoring result into a cache region. According to the methodand the device provided by the embodiment of the invention, the ETL is used for collecting the task, and the data needing to be monitored in the data of the task is packaged into the monitoring object; the system resources are allocated, and the monitored object is continuously monitored; and moreover, the monitoring object is calculated, the monitoring result is stored in the cache region, real-time monitoring is carried out with few resources, the data situation is determined and recorded, an operator can know the data situation in real time, and repairing is carried out in time when collection is abnormal.

Description

technical field [0001] The present application relates to data management, in particular to a data monitoring method and device. Background technique [0002] With the development of digital environmental protection systems, data centers are becoming more and more important, undertaking the tasks of data collection, cleaning and sharing. The collection tasks are mainly carried out using ETL. Although ETL itself has corresponding logs to provide monitoring capabilities. But its function is still relatively simple, and it is difficult to do some more detailed monitoring. Operators can only troubleshoot data problems in a targeted manner when the customer feedback data is abnormal. It is necessary to determine whether the source system does not generate data, the ETL is not running correctly, or the problem of the application system itself. Such an implementation is very costly and inefficient. Contents of the invention [0003] The present application provides a data mon...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/2455G06F16/25G06F9/48
CPCG06F16/24552G06F16/254G06F9/4881
Inventor 周国龙刘术军王登优彭道发
Owner 深圳博沃智慧科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com