Industrial robot auxiliary programming method based on natural language

Abstract

The invention provides an industrial robot auxiliary programming method based on a natural language. The method is characterized in that a corresponding robot execution code is generated according toa language instruction and an environment image. The method is divided into three parts of 1) respectively using a bidirectional recurrent neural network (Bi-RNN) with long short term memory (LSTM) and a fast region convolutional neural network (F-RCNN) to the extract language instruction and factory environment characteristics; 2) proposing a 'multi-attention mechanism' model and a machine translation alignment algorithm to correctly match an object in the environment with the instruction, thereby identifying a specified object and outputting a coordinate point for placing the object; and 3)generating the robot code for operation by using a result output through the model in combination with a CoBlox modular programming mode. According to the industrial robot auxiliary programming methodbased on the natural language, the 'multi-attention mechanism model' is adopted, so that the identification precision is improved, and the problem that a current method cannot accurately identify anobject in the industrial environment is solved; and the modular programming technical scheme simplifies the programming complexity of engineers and effectively improves the development efficiency.

Description

Technical field [0001] This application belongs to the field of robot programming technology, in particular to robot programming technology based on natural language and machine vision. Background technique [0002] With the rapid development of robotics in recent decades, the concept of intelligent manufacturing is deeply rooted in the hearts of the people. Robotic arm technology has been widely used in industrial production environments. Collaborative robots integrate the advantages of humans and mechanical equipment, and work closely with workers on the production line, which can significantly improve production efficiency. [0003] At present, all mechanical tasks must be carefully designed and coded by engineers to assist and replace workers in performing a single mechanical task. Engineers usually use online or offline programming methods to write robot codes. However, these programming methods are too time-consuming and are far from being time-efficient to meet changes in p...

AI Technical Summary

Problems solved by technology

However, such methods only output the behavior and state of the robot, and do not provide the source code needed by industrial engineers

This programming method cannot be modified offline at the code level when the scheme needs to be adjusted in industrial production

Because no code text is generated, it is not conducive to the reuse of similar code in other projects

[0007] In this case, the existing programming technology cannot meet the needs of industrial intelligent manufacturing due to its inherent defects

Images