Big data full-life-cycle management method and system based on duty tracking and application

A technology of full life cycle and management method, applied in the field of big data full life cycle management based on on-duty tracking, it can solve the problems of complex implementation, long connection cycle, strong code intrusion, etc., and achieve cost reduction and strong scalability. , the effect of strong scalability and stability

Pending Publication Date: 2022-04-15
TSINGHUA UNIV +1
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Due to the diversification of languages, the complexity of the process, and the differences in implementation of each component in the big data processing process
If tracking is implemented, each process needs to be implemented separately, the code is intrusive, the docking cycle is long, and it is difficult to maintain later

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data full-life-cycle management method and system based on duty tracking and application
  • Big data full-life-cycle management method and system based on duty tracking and application

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0038] Aiming at the problems existing in the prior art, the present invention provides a method, system and application for full life cycle management of big data based on on-duty tracking. The present invention will be described in detail below with reference to the accompanying drawings.

[0039] Such as figure 1 As shown, the on-duty tracking-based big data life cycle management method provided by the embodiment of the present invention includes:

[0040] S101, creating a probe core project agent-core;

[0041] S102, create a probe plug-in package project agent-plugins;

[0042] S103, implanting the probe core projec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of data tracking, and discloses a big data full life cycle management method, system and application based on duty tracking, in a big data life cycle, in a data acquisition, storage and integration process, a probe is added to collect corresponding link data, and the data is transmitted to a duty tracking platform to perform aggregation analysis, so that the data acquisition, storage and integration efficiency is improved. Visual data are assembled and then stored, a Web tracking function, a topological graph and a monitoring alarm function are opened, and tracking of the life cycle of big data is achieved. According to the method, byte code enhancement and plug-in type collection are adopted, high expandability and stability are achieved, the micro-kernel architecture is used in the data collection stage, the micro-kernel architecture splits a changing part and an invariable part, the test cost is reduced, the stability of a kernel system and other plug-ins can be guaranteed, and the test efficiency is improved. When a new processing process is added, only a corresponding plug-in module needs to be added, and the expandability is extremely high.

Description

technical field [0001] The invention belongs to the technical field of data tracking, and in particular relates to a method, system and application for full lifecycle management of big data based on on-duty tracking. Background technique [0002] At present, with the development of the big data era, people are mining and using more and more data. In the life cycle of data, the value of data determines the length of the entire life cycle of data, the granularity and timeliness of data collection, and the storage method. , integration status, degree of visualization, depth of analysis, and degree of application connection will all affect the value of data. [0003] The management method based on on-duty tracking is to solve the tracking and alarming of data in each life cycle, such as collection, storage, integration, presentation and use, analysis and application, archiving and destruction, etc., to provide rapid positioning to a certain processing process, and improve data q...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/26G06F16/17
Inventor 吴志雄朱升高
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap