Station flow prediction method and device

A traffic forecasting and site technology, applied in the direction of nuclear methods, structured data retrieval, transmission systems, etc., can solve the problems of unreliable site traffic data prediction results, failure to meet reliability and validity requirements, site operating status and network maintenance impact, etc. , to achieve effective prediction results, reduce the influence of one-way factors, and achieve the effects of small errors in actual flow values

Inactive Publication Date: 2020-11-06
XI AN JIAOTONG UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the vigorous development of the Internet, the increase of site business volume and the continuous accumulation of users, the network traffic of the website presents complex and changeable characteristics, and the validity of the site traffic prediction results is increasingly demanding. Due to the characteristics of the management system log traffic and forecasting requirements, the common single forecasting method can no longer meet the reliability and effectiveness requirements. The forecasting results of site traffic data are unreliable and invalid, which will affect the operating status of the site and network maintenance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Station flow prediction method and device
  • Station flow prediction method and device
  • Station flow prediction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0058] First, when a user visits the site, the server will record the user's access information, which includes the traffic value of this request, select a part of the access data, and use the Spark streaming cluster to clean the log data and analyze the data statistics, extract Time-series-based site traffic data is used as experimental data and test data. Real-time data processing of data is achieved by building a distributed cluster Hadoop as the underlying data storage and deploying Spark on Yarn to convert the original log data into structured log data. On this basis, the time and flow fields of the log data are counted. After sorting, it is stored in the HBase database.

[0059] After analyzing and counting the log data for a period of time, a part of the log traffic values ​​are counted as traffic prediction model analysis test data. Read the flow data, calculate the predicted value of Kalman filter and SVM respectively, compare the actual flow value to get the absolut...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a station flow prediction method and device. The method comprises the steps of obtaining log data, calculating a predicted value based on the log data according to a Kalman filtering algorithm and a support vector machine (SVM) in order to obtain effective data more conveniently, calculating a weight by comparing an actual flow value, and constructing a parallel combinationmodel, establishing a prediction model according to a flow sequence in log data, obtaining predicted site network flow values, and using test data to check model prediction precision. By comparing results of Kalman prediction, SVM prediction and parallel combination model prediction based on Kalman and SVM, it is proved that a combination algorithm is adopted to predict network traffic, and the defect of single prediction of a traditional time sequence model is overcome; and the flow prediction result of the parallel combination model is reliable and effective and is more suitable for predicting the station flow. The parallel combination model can be applied to prediction of network traffic in a high-performance computing environment.

Description

technical field [0001] The invention belongs to the field of network flow monitoring, and in particular relates to a site flow prediction method and device. Background technique [0002] With the vigorous development of the Internet, the increase of site business volume and the continuous accumulation of users, the network traffic of the website presents complex and changeable characteristics, and the validity of the site traffic prediction results is increasingly demanding. Due to the characteristics of management system log traffic and forecasting requirements, the common single forecasting method can no longer meet the reliability and effectiveness requirements. The forecasting results of site traffic data are unreliable and invalid, which will affect the operating status of the site and network maintenance. Contents of the invention [0003] The purpose of the present invention is to provide a site traffic forecasting method and device to overcome the deficiencies of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/26G06N20/10G06F16/25G06F16/215
CPCG06F16/215G06F16/254G06N20/10H04L43/0876
Inventor 伍卫国冯培坤柴玉香张祥俊杨诗园王雄
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products