Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed system log analysis method based on federated learning technology

A distributed system and analysis method technology, applied in the field of software development, can solve problems such as inability to apply distributed systems, and achieve the effect of reducing the amount of log data, avoiding transmission, and improving robustness

Pending Publication Date:
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with the rapid development of distributed software systems, a huge amount of log data is generated and distributed in local servers with large geographic spans. Existing methods cannot be applied to distributed systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed system log analysis method based on federated learning technology
  • Distributed system log analysis method based on federated learning technology
  • Distributed system log analysis method based on federated learning technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The specific implementation manner of the present invention will be described in further detail below by describing the best embodiment with reference to the accompanying drawings.

[0024] With the continuous expansion of the scale of software systems and the continuous development of cloud computing, more and more large-scale distributed software systems have been formed, which means that the generated log data will be larger in volume and wider in distribution, which makes manual analysis Each log message is unrealistic; log messages are free-form texts composed of natural language, without unified regulations, and are not structured. Therefore, before analyzing the log data, it is necessary to analyze the log, that is, to extract the template of each original log message and make it into a structured table. Using structured log data greatly reduces the difficulty of log analysis. The log file is generated from the logging statement in the source code, such as the lo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed system log analysis method based on a federated learning technology, which comprises the following steps of establishing a relation between local servers and a central server, establishing neural network models in the local servers for analyzing local log data, and updating neural network model parameters in each local server by the central server. The method has the advantages that the method is more suitable for log analysis of the distributed system, log analysis of the distributed system is more accurate and reliable, meanwhile, the analysis efficiency is higher, and good robustness is achieved.

Description

technical field [0001] The invention relates to the field of software development, in particular to a distributed system log parsing method based on federated learning technology. Background technique [0002] The system log contains important system operation information, which is of great significance to the development and maintenance of the system. Before analyzing log data, such as anomaly detection, it is necessary to analyze the log first, that is, to extract the log template and convert the log data set containing the original log message into a structured table. Therefore, many automatic log parsing methods have been proposed. However, with the rapid development of distributed software systems, a huge amount of log data is generated and distributed in local servers with large geographical spans. The existing methods cannot be applied to distributed systems. Contents of the invention [0003] The purpose of the present invention is to overcome the deficiencies of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/182G06F16/17G06K9/62G06N3/08
CPCG06F16/1815G06F16/1734G06F16/182G06N3/08G06F18/214
Inventor 章一磊李欣园罗永龙程厚敏张梦蝶
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com