Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Frame and method for developing reinforcement learning system

A technology of reinforcement learning and framework, applied in biological models, instruments, computing models, etc., can solve problems such as complex structures and repetitive labor

Active Publication Date: 2010-06-16
CHANGCHUN INST OF TECH +2
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Traditionally, it is necessary to start from scratch to develop a system based on reinforcement learning. There is no general framework to use, resulting in a lot of duplication of labor, and because there is no standard to follow, it may lead to complex and confusing structures

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Frame and method for developing reinforcement learning system
  • Frame and method for developing reinforcement learning system
  • Frame and method for developing reinforcement learning system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] refer to figure 1 , the reinforcement learning system obtains the status and rewards by observing the environment, after learning and adjusting, it makes actions on the environment, then observes the environment, decides the next action, and so on, and finally reaches the desired environment state.

[0044] refer to figure 2 , the present invention includes a learner interface that interacts with the external environment, and is a module for the reinforcement learning system to organize other interfaces for learning and decision-making, including initializing learning, observing the environment, obtaining rewards, performing learning and updating internal state values, and obtaining the best There are six overloadable methods for action and execution action. The learner implements the Q learning algorithm by default. The initialization learning method is used to initialize the learning factor and the discount factor. It returns a true value after success, otherwise it ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a frame and method for developing a reinforcement learning system, which is characterized in that a learner interface interactive with the external environment, a state interface for showing the environment state, an action interface of which the action is executed by the system through an executive component, a basic testing environment and other parts constitute the frame, and then, the frame is used for developing the reinforcement learning system, wherein the learner interface acquires the environment state through the state interface, updates the internal state by learning, makes a decision and calls the action interface to act on the environment. Meanwhile, the study group of the invention also provides the implementation of a new multi-robot reinforcement learning algorithm based on the quantum theory to be used as example demonstration. Developers can finish the development of robots or other intelligent device learning modules only by realizing the corresponding interfaces according to certain steps. The frame of the invention has high portability, can operate in many platforms, can be combined with other robot system frames for use, greatly reduces the compiling complexity of the learning algorithm, and has simple method.

Description

technical field [0001] The invention relates to a framework and method for developing a reinforcement learning system. Background technique [0002] Reinforcement learning, also known as reinforcement learning, is a special and environment-adaptive machine learning method that takes environmental feedback as input. Since the late 1980s, with breakthroughs in the mathematical foundational research of reinforcement learning, the research and application of reinforcement learning has been increasingly carried out, and it has become one of the research hotspots in the field of machine learning. [0003] Reinforcement learning technology can learn the optimal behavior strategy of a dynamic system by perceiving the state of the environment and obtaining uncertain reward values ​​from the environment, and only through similar trial and error methods, thus attracting many researchers. So far, reinforcement learning is immature in many fields, and further research on reinforcement l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N1/00G06N3/00
Inventor 孟祥萍谭万禹皮玉珍苑全德纪秀
Owner CHANGCHUN INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products