Mass log management cloud platform

A cloud platform and log technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of limited system performance, hardware performance, hard to retrieve, data loss, etc., and achieve fast search and analysis of logs Effect

Inactive Publication Date: 2015-09-23
山东蚁巡网络科技有限公司
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1. After the log capacity increases, the log storage, query, and analysis performance of the system all decline, because there is no good horizontal expansion capability, and the system performance is often limited by hardware performance
[0005] 2. No ability to full-text index logs
[0006] 3. Single point of failure
When the hardware storage device in the system fails, the data will be lost and difficult to retrieve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass log management cloud platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0025] like figure 1 As shown, a massive log management cloud platform includes a log collection system 01, a log processing system 02, a log index and storage system 03, and a log query application system 04.

[0026] The server 00 where the log resides sends the log to the log collection system 01 in the form of syslog.

[0027] The log collection system 01 is located at the forefront of the platform and is used to collect logs into the platform. It is a massive log aggregation system cluster and a distributed and highly reliable log collection system. It supports collecting logs of various protocols and formats such as syslog, HTTP, Log4J, files, and file changes.

[0028] It has the following characteristics:

[0029] a) High availability. Availability (availability) refers to the total time of system running without failure within a fixed perio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mass log management cloud platform, which comprises a log collection system (01), a log processing system (02), a log indexing and storage system (03) and a log query and application system (04). The mass log management cloud platform is a cloud log management system which can carry out full-text indexing on a log to more quickly search and analyze the log; cloud storage is adopted to prevent the log from being limited to the volume of storage hardware; and the problem of log data loss caused by a single point of failure can be solved. A log message processing subsystem (021) is added in the log processing system (02) and is responsible for transmitting the received log to a real-time flow processing subsystem (022) so as to realize decoupling of the acquisition and processing of logs . If the log indexing and storage system fails, the log message processing subsystem (021) can automatically and temporarily stores a message in a hard disk in a persistence way, and therefore, a phenomenon that the log received by the system is lost due to the exception of the indexing and storage system can be avoided.

Description

technical field [0001] The invention relates to the field of computer applications, in particular to a massive log management cloud platform. Background technique [0002] Traditional log analysis systems usually collect device logs locally. First, the logs are sent to the local server, and are directly stored in the database after analysis or without analysis. Then, the log data is searched and analyzed through the management interface. [0003] Traditional log analysis systems will encounter the following problems when analyzing logs: [0004] 1. After the log capacity increases, the system's log storage, query, and analysis performance all decline. Because there is no good horizontal expansion capability, the system performance is often limited by hardware performance. [0005] 2. There is no ability to full-text index logs. [0006] 3. Single point of failure. When the hardware storage device in the system fails, the data will be lost and difficult to retrieve. Cont...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/1815G06F16/13
Inventor 李文君张明梁鹏飞
Owner 山东蚁巡网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap