Log data processing method and system

A data processing and log technology, applied in the computer field, can solve problems such as heavy log data pressure, log summary server downtime, and log data loss, so as to relieve the pressure of receiving log data, reduce the risk of downtime, and reduce loss Effect

Active Publication Date: 2018-08-10
PINGAN PUHUI ENTERPRISE MANAGEMENT CO LTD
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Usually, the method of storing log data is that each subsystem writes the log data corresponding to each operation to the log summary server in real time. However, when the data flow is large, the log summary server is under great pressure to receive the log data of all subsystems in real time. Seriously, it may cause the log summary server to go down, resulting in the loss of some log data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method and system
  • Log data processing method and system
  • Log data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0033] The log data processing method provided by this application can be applied to such as figure 1 shown in the application environment. refer to figure 1 , the log data processing method is applied to the log data processing system 100 . The log data processing system 100 includes a business server 102 , a data center server 104 and a log summary server 106 . Wherein, the business server 102 is connected to the data center server 104 through the network, and the data center server 104 is connected to the log aggregation server through the network. The business serv...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a log data processing method and system. The method comprises the following steps of: creating a plurality of log data reading instances corresponding to a message queue in adata center server; from a second preset time, opening the created log data reading instances in sequence by taking a preset time period as an interval; respectively reading log data from the messagequeue through the log data reading instances which are opened in sequence; and after the read log data is stored persistently, closing the log data reading instances which read the log data until thelog data in the message queue is completely read. By adoption of the method, the condition that the log data is lost in the transmission process can be decreased.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a log data processing method and system. Background technique [0002] With the rapid development of enterprises, the businesses involved are becoming more and more extensive. In order to improve the efficiency of business processing, enterprises will build corresponding subsystems for each business, and users can log in to the subsystems to process related businesses. However, after the business was "moved" to online processing, many users logged into each subsystem, and improper operations of users led to information leakage, which caused losses to the enterprise. [0003] In order to supervise the improper operations of users, it is necessary to store log data related to user operations for subsequent analysis of the reasons for information leakage. Usually, the method of storing log data is that each subsystem writes the log data corresponding to each operation t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54G06F17/30
CPCG06F9/546G06F16/1815
Inventor 杜长闯刘元勋谢曦时
Owner PINGAN PUHUI ENTERPRISE MANAGEMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products