Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A log collection method and apparatus based on a cloud platform

A cloud platform and log technology, applied in the field of operation and maintenance, to achieve the effect of satisfying complex query and analysis and reducing the time for troubleshooting

Inactive Publication Date: 2019-02-05
SHENZHEN POWER SUPPLY BUREAU +1
View PDF6 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The technical problem to be solved by the present invention is to provide a log collection method and device based on a cloud platform. The method and device realize the output of log information generated by different log files to different message queue classification topics, reducing the number of operations and maintenance personnel to check. The time of the problem, unified centralized storage, can meet the complex query and analysis, and understand the needs of users through logs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A log collection method and apparatus based on a cloud platform
  • A log collection method and apparatus based on a cloud platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0064] Based on Embodiment 1 of the present invention, Embodiment 2 of the present invention provides a log collection device based on a cloud platform, such as figure 2 As shown, the device includes a log collection and sending module 1, a message queue module 2, and a log parsing and storage module 3, wherein,

[0065] The log collection and sending module 1 is used to obtain the log information generated by the log file, and publish the log information to the topic corresponding to the classification of the log information in the message queue according to the classification information of the log information;

[0066] A message queue module 2, configured to store the log information;

[0067] The log parsing and storage module 3 is used to obtain the business tracking data from the message queue from the topic corresponding to the message queue, and parse the business tracking data into data in a warehousing format, and store the parsed data into the warehousing process ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a log collection method and a system based on a cloud platform. The method comprises the following steps: S1, acquiring log information generated by a log file, and according tothe classification information of the log information, publishing the log information to a subject corresponding to the classification of the log information in a message queue; S2, obtaining servicetracking data from a subject corresponding to a message queue, and parsing the service tracking data into data in a warehousing format; S3, carrying out warehousing processing on the data in the warehousing format. The invention can reduce the time of the operation and maintenance personnel to check the problem, uniformly centralize the storage, can meet the complex inquiry and analysis, and canunderstand the requirements of the user through the log.

Description

technical field [0001] The present invention relates to the technical field of operation and maintenance, in particular to a method and device for collecting logs based on a cloud platform. Background technique [0002] With the development of cloud computing, large-scale data centers have become the standard configuration for most companies. These clusters run distributed basic software and services to provide users with data services and computing capabilities. In order to better serve customers, all data centers will record user behavior logs and runtime logs when using Internet applications, and then the logs generated by distributed applications are also on each node in the cluster, and the generation of log files is also distributed In this way, it is the first step to collect and store the log files scattered in the cluster on a unified cloud storage platform. [0003] The Hadoop platform is a distributed software platform supported by the Apache Foundation, which i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/93
Inventor 冷迪刘威黄建华陈瑞吕志宁庞宁
Owner SHENZHEN POWER SUPPLY BUREAU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com