Log data enhancement method and system and log data classification detection method and system

A data classification and log technology, applied in transmission systems, neural learning methods, biological neural network models, etc., can solve problems such as similarity and overfitting malicious threat misjudgment, lack of representative samples, and imbalance of log data samples. , to solve the similarity and over-fitting problems and reduce the cost

Inactive Publication Date: 2021-04-30
BEIJING TOPSEC NETWORK SECURITY TECH +2
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the above-mentioned technical problems of unbalanced log data samples, similarity and overfitting caused by lack of representative samples, and misjudgment of malicious threats, the present invention discloses a log data enhancement method, classification detection method and system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data enhancement method and system and log data classification detection method and system
  • Log data enhancement method and system and log data classification detection method and system
  • Log data enhancement method and system and log data classification detection method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0055]In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.

[0056] The embodiment of the present disclosure provides a log data enhancement method, which can effectively solve the sample imbalance problem of normal and malicious samples in the log data, wherein the sample imbalance problem includes label classification imbalance and misclassification cost ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log data enhancement method and system and a log data classification detection method and system. The method comprises the steps of proprocessing collected log data; merging the preprocessed log data; constructing a generative adversarial network model, and training the generative adversarial network model by utilizing the log data subjected to the data merging processing; generating a log data sample according to the trained generative adversarial network model; and performing data combination based on the log data sample and the log data subjected to the data merging processing to form an enhanced log data set. The problem of unbalanced log data samples in the field of network space security can be effectively solved, the problems of similarity and overfitting caused by lack of representative samples and the problem of classification detection of unknown network threats are solved, and the purposes of log data enhancement and expansion and classification detection are achieved.

Description

technical field [0001] The present disclosure relates to the technical fields of network security and artificial intelligence, and in particular to a log data enhancement method, a classification detection method and a system. Background technique [0002] In the field of cyberspace security, there is an imbalance between normal samples and threat samples in the log data. In the actual log data collection, there is only a small amount of threat data, so it is necessary to perform data enhancement on a small amount of threat data. [0003] At this stage, for data enhancement, on the one hand, sampling technology, that is, artificial data synthesis is used to enhance the data set. Only relying on manual collection of more scarce categories of data, the balance of the data set cannot be achieved, and the data set itself is very scarce and cannot be realized. Samples of efficient size are employed. Methods including undersampling, oversampling, and data synthesis will lead to o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06G06N3/04G06N3/08
CPCH04L63/1425G06N3/08G06N3/045
Inventor 陈龙王炜江军王巧娟
Owner BEIJING TOPSEC NETWORK SECURITY TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products