Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data log analysis method and system based on Spring framework

A big data and log technology, applied in the field of information security, can solve the problems of missing log archiving, management, and WEB services that cannot make unified alarm management, risk early warning, and cannot be predicted in advance and deal with problems in a timely manner, so as to ensure accuracy and consistent effect

Pending Publication Date: 2021-08-20
联通(江苏)产业互联网有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Not only is the function of log archiving and management missing, but also unified alarm management and risk warning cannot be made for each WEB service; neither developers nor operation and maintenance personnel can accurately locate various problems on services and servers, nor can they There is no way to efficiently search the log content to quickly locate the problem; at the same time, it is impossible to predict and deal with the problem in time, which greatly affects the customer's perception experience, so a centralized, independent, log information collection and management on each service and server is needed , centralized management, timely early warning, and provide a good UI interface for data display, processing and analysis, and at the same time conduct data mining on customer behavior to extract greater business value

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data log analysis method and system based on Spring framework
  • Big data log analysis method and system based on Spring framework
  • Big data log analysis method and system based on Spring framework

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] In order to make the technical solutions of the present invention clearer and clearer to those skilled in the art, the present invention will be further described in detail below in conjunction with the examples and accompanying drawings, but the embodiments of the present invention are not limited thereto.

[0067] Such as Figure 1-Figure 5 As shown, the method and system for big data log analysis based on the Spring framework provided in this embodiment, a method for big data log analysis based on the Spring framework, the method includes the following steps:

[0068] Step 1: Logs are collected in a unified manner. In different Spring frameworks, add logback dependencies in the POM file, and create a new logback.xml file in the resources directory of each service;

[0069] Step 2: Logstash data into ES, create a new trace-logging.conf file under the logstash config directory, store real-time logs into ES, and then perform stream processing through Flink;

[0070] St...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a big data log analysis method and system based on Spring frameworks, and belongs to the technical field of information security, and the method comprises the following steps: uniformly collecting logs, in different Spring frameworks, newly adding logback dependency in a POM file, and meanwhile, newly establishing a logback.xml file under a resource directory of each service. According to the invention, a unified management platform is provided for internal WEB services of different Spring frameworks; the data is analyzed and mined from offline and real-time dimensions, so that the accuracy and consistency of the data are ensured; and the functions of searching time, service names, log levels and keywords are provided, so that development, operation and maintenance personnel can quickly position the production environment.

Description

technical field [0001] The invention relates to a method and system for big data log analysis based on a Spring framework, and belongs to the technical field of information security. Background technique [0002] In today's complex and diverse enterprise WEB services, not only the various service frameworks of Spring MVC, Spring Boot, and Spring Cloud are integrated, but also the logging methods are varied and varied. Not only is the function of log archiving and management missing, but also unified alarm management and risk warning cannot be made for each WEB service; neither developers nor operation and maintenance personnel can accurately locate various problems on services and servers, nor can they There is no way to efficiently search the log content to quickly locate the problem; at the same time, it is impossible to predict and deal with the problem in time, which greatly affects the customer's perception experience, so a centralized, independent, log information coll...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/18G06F16/182G06F16/2458
CPCG06F16/1815G06F16/2465G06F16/182
Inventor 徐敏
Owner 联通(江苏)产业互联网有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com