Computing unloading and resource management method in edge calculation based on deep reinforcement learning

An edge computing and reinforcement learning technology, applied in the field of edge computing, can solve problems such as resource allocation and computing offloading decisions that cannot be well determined, and achieve the effect of maximizing self-interest and reducing execution time

Pending Publication Date: 2021-12-21
TIANJIN UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problem that the existing technology cannot well determine resource allocation and computing offloading decisions, the present invention proposes a computing offloading and resource management method in edge computing based on deep reinforcement learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Computing unloading and resource management method in edge calculation based on deep reinforcement learning
  • Computing unloading and resource management method in edge calculation based on deep reinforcement learning
  • Computing unloading and resource management method in edge calculation based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] Next, the technical solutions in the embodiments of the present invention will be described in connection with the drawings of the embodiments of the present invention, and it is understood that the described embodiments are merely the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained in the art without paying creative labor, all of the present invention.

[0066] In order to deal with the problem of insufficient processing capacity of terminal equipment, limited resources, the industry introduces computing uninstall concepts in the moving edge calculation (MEC). Edge Calculation Unloading, Calculating the unloading is a key technique in MEC, mainly including two parts of uninstall decision making and resource allocation, which reasonably arranges the user terminal to uninstall the computing task to the MEC server, and allocate the resources for task calculation. Reduce the del...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a computing unloading and resource management method in edge computing based on deep reinforcement learning, which comprises the following steps: constructing an edge computing communication model based on a partially observable Markov decision process, the edge computing communication model comprising M + N agents, the M agents being edge nodes, and the N agents being users; setting a target optimization function according to a user cost minimization target and an edge node utility maximization target; setting a time slot length, a time frame length, an initialization time slot and a time frame; enabling the edge node and the user to respectively use the partial observable Markov decision process to obtain a resource allocation strategy and a task unloading strategy; according to the task unloading strategy and the resource allocation strategy, optimizing a target optimization function by utilizing a participant-criminator model; and dividing and processing the computing task according to the optimized target optimization function. According to the invention, different interest pursues between the edge device and the user are solved, and respective interests are ensured to the maximum extent.

Description

Technical field [0001] The present invention belongs to the field of edge calculation, and in particular to calculating unloading and resource management methods based on edge calculations based on deep strengthening learning. Background technique [0002] With the continuous advancement of science and technology and industrial production capacity, the calculation and communication capacity of mobile devices continues to improve, but all kinds of new mobile applications have put forward higher business needs for mobile devices. In a cluster of a multilateral edge, the user can choose to calculate or uninstall the task locally or unload to the edge device. To respond to innovative applications and user experience growing demand, the uninstallation will calculate the intensive task from the user to the edge. The calculation capability of the edge device is generally stronger than the user, so the user may obtain some time delay and power consumption by uninstalling the calculation ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06F9/445G06N3/04G06N3/08
CPCG06F9/5027G06F9/5072G06F9/44594G06N3/08G06N3/048
Inventor 王晓飞李沅泽刘志成赵云凤宋金铎仇超
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap