Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Global optimization system and method based on continuous motion learning automata

A technology of global optimization and action learning, applied in machine learning, computational models, computing, etc., can solve the problems of local minima and weak anti-noise ability, and achieve the effect of improving the convergence speed

Inactive Publication Date: 2019-01-15
SHANGHAI JIAO TONG UNIV +1
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the classic continuous action set learning automaton algorithm can also converge to the best behavior, there are serious problems that it is easy to fall into local minima and the anti-noise ability is relatively weak.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Global optimization system and method based on continuous motion learning automata
  • Global optimization system and method based on continuous motion learning automata

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In the field of optimal path selection and optimal treatment effect (such as: maximization of information dissemination, optimal metering drug selection, etc.), this method can first obtain the local optimal solution of the current path through the existing CALA algorithm, because the path It may be only a local optimal path, not a global optimal path, and then an improved smoothing function is obtained according to the local optimal solution; the improved smoothing function is introduced into the existing CALA algorithm to obtain an optimized CALA algorithm, and the optimized CALA algorithm is used to perform After multiple iterations, the extreme point is finally obtained, which is output as the global minimum value after path selection, so as to obtain the optimal path selection scheme.

[0025] Described iteration refers to: introduce improved smoothing function in CALA algorithm and carry out one round of iteration to obtain local optimum solution, when this round o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A global optimization system and method based on continuous action learning automata are provided, wherein the system includes: an initialization module, a behavior selection module, an environment feedback module, an updating module and an output module, wherein: the initialization module initializes parameters of CALA algorithm and inputs results into the behavior selection module to conduct behavior selection, wherein the behavior is fed back through the application of the path environment and enters environment feedback module, thereby obtaining the corresponding environment feedback and the local optimal solution. The updating module updates the algorithm parameters according to the environment feedback, inputs the updated parameters into the behavior selection module to complete an iteration, and improves the smoothing function. The improved smoothing function is introduced into next iteration environment feedback module for performing iteration many times, thereby obtaining theextreme value point finally. The current environment feedback is input into the output module to output the optimal path as the global minimum. The invention is reasonable in design, introduces a smoothing function and adds a slope component for improvement, so that CALA can easily jump out of a local minimum solution, and the subsequent searching has directionality, thereby greatly improving theconvergence speed and the correct rate of the algorithm.

Description

technical field [0001] The invention relates to a technology in the field of learning automata optimization, in particular to a global optimization system and method based on continuous action learning automata. Background technique [0002] The stochastic function optimization method generally uses the probability mechanism to describe the iterative process of its solution, which is different from the deterministic point sequence in the deterministic functional method, thus showing that the important basis of the algorithm is randomness. Such algorithms have a wide range of applications and can often be used to solve large-scale continuous and discrete function optimization, combinatorial optimization and other problems. The algorithm can theoretically guarantee to converge to the global optimal value with probability 1, but it takes a lot of time. Because the learning automaton has the advantages of strong anti-interference ability and global optimization ability, it has ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N20/00
Inventor 李生红葛昊马颖华黄德双江文狄冲周之晟李怡晨
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products