Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-target flexible job shop scheduling method and device based on deep reinforcement learning

A technology of intensive learning and flexible operation, applied in neural learning methods, biological neural network models, instruments, etc., can solve problems such as huge computational burden, inability to achieve multi-objective optimization, and reduced algorithm efficiency

Pending Publication Date: 2020-12-29
TSINGHUA UNIV
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Storing such a large and complex Q table will not only introduce a huge computational burden, but also introduce a large number of useless states that have never been experienced, which reduces the efficiency of the algorithm, and the existing dynamic scheduling algorithms based on reinforcement learning often only consider a single Optimizing objectives (e.g. total tardiness), unable to achieve multi-objective optimization

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-target flexible job shop scheduling method and device based on deep reinforcement learning
  • Multi-target flexible job shop scheduling method and device based on deep reinforcement learning
  • Multi-target flexible job shop scheduling method and device based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0035] The following describes the multi-objective flexible job shop scheduling method and device based on deep reinforcement learning according to the embodiments of the present invention with reference to the accompanying drawings.

[0036] In the related technologies, most of them are aimed at the simple job shop scheduling problem, that is, the processing machine of each process is given in advance, and can only be processed by the designated machine, so it is only necessary to determine the processing sequence of each process...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-target flexible job shop scheduling method and device based on deep reinforcement learning, and relates to the technical field of dynamic scheduling. The method comprises the steps: reading a production line state feature vector at a current rescheduling moment, and inputting the production line state feature vector into a trained target strategy network of a targetintelligent agent to obtain a scheduling target; inputting the production line state feature vector and the scheduling target into the workpiece strategy network of the trained workpiece intelligentagent to obtain a workpiece assignment rule, and inputting the workpiece assignment rule into the machine strategy network of the trained machine intelligent agent to obtain a machine distribution rule; selecting a to-be-machined workpiece according to the workpiece assignment rule, selecting a machining machine according to the machine allocation rule, and machining the next procedure of the to-be-machined workpiece through the machining machine. Therefore, different optimization objectives, workpiece assignment rules and machine allocation rules are intelligently selected according to the state of the production line at different rescheduling moments, and multi-objective collaborative optimization and complete real-time, autonomous and unmanned intelligent factories are realized.

Description

technical field [0001] The invention relates to the technical field of dynamic scheduling, in particular to a multi-objective flexible job shop scheduling method and device based on deep reinforcement learning. Background technique [0002] In related technologies, most of the multi-objective flexible job shop dynamic scheduling methods are based on simple scheduling rules or meta-heuristic algorithms. Simple scheduling rules mainly include first-come-first-out (FIFO for short), shortest delivery time first ( Earliest due date, referred to as EDD), the longest remaining processing time priority (Most remaining processing time, referred to as MRPT), etc., which select a workpiece to process on a machine at each rescheduling time, which has the advantage of high real-time It can respond to uncertain events immediately, but its disadvantage is that it is short-sighted and cannot get a better scheduling plan in the long run, and a single scheduling rule is often applicable to a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06G06N3/08G06N3/04
CPCG06Q10/0631G06N3/08G06N3/045
Inventor 张林宣罗术
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products