Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A distributed social network structure fast mining system for large-scale network traffic

A technology of network traffic and network structure, applied in the field of rapid mining system of distributed social network structure, can solve the problems of no data allocation plan, inability to directly migrate to, and high errors, so as to reduce memory consumption, improve efficiency, and improve accuracy. Effect

Active Publication Date: 2019-08-13
西安交通大学深圳研究院
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the one hand, some methods are based on pool sampling or sampling with a fixed probability, which can perform real-time measurement of dynamically generated stream data, but the error is high, and no data distribution scheme for measurement on a distributed system is proposed; on the other hand , some methods first sample large network data to form sub-networks, and then use the parallel and fast computing power of distributed systems to mine and count the triangular topology of sub-networks, but they cannot be directly migrated to social networks formed by large-scale network traffic. Real-time mining of network structure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed social network structure fast mining system for large-scale network traffic
  • A distributed social network structure fast mining system for large-scale network traffic
  • A distributed social network structure fast mining system for large-scale network traffic

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the implementation manners of the present invention will be described in detail below in conjunction with the drawings and embodiments.

[0029] Such as figure 1 As shown, the system consists of three subsystems, which are data processing subsystem, network structure mining subsystem and data storage subsystem. The input data of the system is large-scale network traffic. The data processing subsystem analyzes the network traffic and extracts the network traffic data contained therein, including the five-tuple of data packets (source IP address, destination IP address, source port number, destination port number , protocol) or any combination of some of the data, and at the same time distribute the extracted data to each processing unit of the network structure mining subsystem.

[0030] The network structure mining subsystem includes multiple process...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed social network structure rapid mining system facing large-scale network traffic. The distributed social network structure rapid mining system is used for carryingout distributed allocation and storage on the large-scale network traffic generated at a high speed and mining a topological structure in a social network, and comprises three data processing, networkstructure mining and data storage subsystems; the distributed social network structure rapid mining system faces the large-scale network traffic and proposes an original distributed data allocation and storage model; by proposing the original distributed data allocation and storage model, the topological structure in the social network can be subjected to different particle sizes of measurement;the distributed social network structure rapid mining system is applicable to large-scale streaming data and can be used for network topological structure measurement; and user identity prediction, community detection, abnormal behavior mining and the like can also be carried out on the basis of a measurement result of the network topological structure.

Description

technical field [0001] The invention belongs to the technical field of data mining, in particular to a distributed social network structure rapid mining system for large-scale network traffic. Background technique [0002] With the rapid development and wide application of Internet technology, the social network composed of users is becoming larger and larger. For the analysis of a single user, the network structure information that can be obtained is relatively limited. Mining the topological structure of the social network where the user lives can provide a deeper understanding of the network environment where the user lives. It is useful for understanding user characteristics from multiple dimensions, predicting user identities, mining abnormal groups in social networks, and maintaining public security. Network security and building a harmonious network environment are of great significance. [0003] In the social network built by users, network traffic is the main medi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/24H04L12/26H04L29/08
CPCH04L41/12H04L41/142H04L43/50H04L67/10H04L67/1097
Inventor 王平辉贾鹏王翔宇孙飞扬齐逸岩曾菊香许诺兰林管晓宏陶敬韩婷
Owner 西安交通大学深圳研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products