Method and device for real-time statistics of logs

A statistical method and log technology, applied in the computer field, can solve the problems of high cost and poor statistical performance, and achieve the effect of low storage cost, saving hardware cost, and reducing the number of network IOs.

Inactive Publication Date: 2015-05-27
SHENZHEN TENCENT COMP SYST CO LTD
View PDF6 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] The purpose of the embodiment of the present invention is to provide a log real-time statistical method and device to solve the problems of poor statistical performance and high cost of existing log real-time clustering statistical methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for real-time statistics of logs
  • Method and device for real-time statistics of logs
  • Method and device for real-time statistics of logs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The aforementioned and other technical contents, features and effects of the present invention will be clearly presented in the following detailed description of the preferred embodiments with reference to the drawings. Through the description of specific implementation methods, the technical means and effects of the present invention to achieve the intended purpose can be understood more deeply and specifically, but the attached drawings are only for reference and description, and are not used to explain the present invention limit.

[0033] See figure 2 , which is a flow chart of a log real-time statistics method according to an embodiment of the present invention, which includes the following steps:

[0034] S201, configure cluster statistics rules. The cluster statistics rules are used to preliminarily filter the logs produced by the production system. The cluster statistics rules can be configured according to the needs, and the configured cluster statistics rul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention provides a method and a device for real-time statistics of logs. The method comprises the following steps of configuring a cluster statistics rule; carrying out rule matching on on-line logs and recording to-be-statistical information which meets the cluster statistics rule; receiving the recorded to-be-statistical information which conforms to the cluster statistics rule at every statistical period; carrying out cluster statistics operation on the received to-be-statistical information; storing a statistical result subjected to the cluster statistics operation; and querying the stored statistical result according to a received query request and showing a query result. The method and the device have the advantages of high statistical performance, low hardware requirements and capability of greatly saving the hardware cost.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for real-time log statistics. Background technique [0002] Internet services have become an essential part of people's lives. Every day, applications such as instant messaging, games, e-commerce, and search generate massive operating logs. As an Internet service provider, it conducts real-time clustering statistics on massive logs, such as statistics on the UV (unique visitor, website unique visitor) value and PV (Page View, page views) value of the website, so as to monitor the abnormality of the service in real time. It is an Internet product common functions. [0003] To perform real-time cluster statistics on logs, the traditional solution is to store logs in the database first, and then perform cluster statistics analysis in near real time. Such as figure 1 As shown, the current clustering statistics of logs includes the following process: [0004...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24
Inventor 林汇宝朱亮李潇
Owner SHENZHEN TENCENT COMP SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products