Network selection method and device based on Markov decision process

Abstract

The embodiment of the invention provides a network selection method and device based on a Markov decision process, and the method comprises the steps: building a Markov decision process model, and determining the state space, behavior space and transition probability of a terminal selection network; obtaining a network performance normalization weight vector of each network and a preset service quality performance index weight vector; obtaining transfer income according to the network performance normalization weight vector, the service quality performance index weight vector, the state spaceand the behavior space; and according to the transfer income and the transfer probability, obtaining a corresponding system state when the long-term income is maximum, and obtaining a network selection result of the terminal. According to the network selection method and device based on the Markov decision process provided by the embodiment of the invention, the performance demand difference of the terminal task under different service qualities is fully considered to obtain the transfer income, the long-term income of the system is considered, the system state of the system at the maximum income is calculated, and the terminal network selection scheme is obtained.

Description

technical field [0001] The present invention relates to the technical field of 5G ultra-dense networks and heterogeneous networks, in particular to a network selection method and device based on a Markov decision process. Background technique [0002] With the rapid development of the mobile Internet and the Internet of Things, the mobile communication business is growing rapidly. It is estimated that by 2021, the global mobile data business volume will increase by 7 times. Compared with 2010, cellular wireless networks will face 1000 times the data volume challenge in 2020. In order to meet the rapid growth of data traffic, massive device connections, and emerging new business and application requirements, the deployment requirements of the new generation of 5G mobile networks are proposed. The 5G mobile network has the characteristics of higher data traffic, user experience rate, massive terminal connections, lower latency, and higher reliability. By densely deploying lo...

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a network selection method and device based on Markov decision process, which is used to solve the technical problem that the service quality of the task cannot be guaranteed in the prior art

Images