Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Action determination method and device, readable medium and electronic equipment

A technology of action and location information, applied in the direction of motion accessories, character and pattern recognition, instruments, etc., can solve the problems of DRL algorithm difficulty, failure to reflect the correlation between environmental images and object information, and DRL algorithm is difficult to extract, etc., to achieve improvement The effect of accuracy

Pending Publication Date: 2021-08-06
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, using such an information fusion method cannot reflect the correlation between the environment image and object information, which will make it difficult for the DRL algorithm to extract important features from the environment information, and thus make it difficult for the DRL algorithm to generate correct actions.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Action determination method and device, readable medium and electronic equipment
  • Action determination method and device, readable medium and electronic equipment
  • Action determination method and device, readable medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein; A more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for exemplary purposes only, and are not intended to limit the protection scope of the present disclosure.

[0032] It should be understood that the various steps described in the method implementations of the present disclosure may be executed in different orders, and / or executed in parallel. Additionally, method embodiments may include additional steps and / or omit performing illustrated steps. The scope of the present disclosure is not limited in this regard. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an action determination method and device, a readable medium and electronic equipment, and relates to the technical field of machine learning, and the method comprises the steps: obtaining an environment image of an environment where a target object is located and an object feature vector of each environment object in the environment image, determining the position information of each environment object in the environment image, and for each environment object, splicing the object feature vector of the environment object to a position corresponding to the position information of the environment object, and taking the spliced environment image as input of a pre-trained action model to obtain a target action to be executed by the target object output by the action model. According to the method, the object feature vectors are spliced to the positions corresponding to the position information, so that the object feature vectors and the position information have relevance, the action model can quickly extract important features from the spliced environment image, and the accuracy of the target action output by the action model is improved.

Description

technical field [0001] The present disclosure relates to the technical field of machine learning, and in particular, relates to an action determination method, device, readable medium and electronic equipment. Background technique [0002] In recent years, DRL (English: Deep Reinforcement Learning, Chinese: Deep Reinforcement Learning), as one of the important research directions of machine learning technology, has been widely used in the fields of games, robot control and automatic driving. DRL can be divided into two stages: environmental cognition and decision-making. In the environmental cognition stage, the deep neural network is usually used to perform representation learning on the multi-modal fusion environmental information, and then output the deep semantic information obtained by representation learning to the decision-making network for decision-making. learn and generate corresponding optimal actions. [0003] Usually, when the environment information includes ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): A63F13/55G06K9/62
CPCA63F13/55G06F18/25G06F18/214
Inventor 范嘉骏
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products