a training device

A technology of training device and data processing module, which is applied in the direction of biological neural network model, neural architecture, neural learning method, etc., and can solve the problem that the neural network training process cannot be completed, the reverse training part cannot be accelerated, the reverse training part is not considered, etc. problems, to achieve the effect of reducing training power consumption, increasing computing speed, and improving training speed

Active Publication Date: 2021-06-01
SHANGHAI CAMBRICON INFORMATION TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for the existing accelerators, most of them only support the forward speculation part, and do not consider the reverse training part. Therefore, this also brings about a problem that the accelerator can only accelerate the forward speculation part, but cannot accelerate the reverse training part. part, it is impossible to complete the entire training process of the neural network, which has obvious limitations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • a training device
  • a training device
  • a training device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0055] It should be noted that, in the drawings or descriptions of the specification, similar or identical parts all use the same figure numbers. Implementations not shown or described in the accompanying drawings are forms known to those of ordinary skill in the art. Additionally, while illustrations of parameters including particular values ​​may be provided herein, it should be understood that the parameters need not be exactly equal to the corresponding values, but rather may approximate the corresponding values ​​within acceptable error margins or design constraints. In addition, the directional terms mentioned in the following embodiments, such as "upper", "lower", "front", "rear", "left", "right", etc., are onl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present disclosure provides a training device, comprising: a data processing module; and a computing module connected to the data processing module and configured to receive data processed by the data processing module for computing. The disclosed training device can effectively accelerate the reverse training part, and can also be used to accelerate the training process of the entire neural network, which improves the training and computing speed, reduces the training power consumption, and improves the computing effectiveness.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, in particular to a sparse training device. Background technique [0002] Deep neural network is the basis of many artificial intelligence applications at present. It has achieved breakthrough applications in many aspects such as speech recognition, image processing, data analysis, advertising recommendation system, and automobile automatic driving, making deep neural network applied in daily life. every aspect. However, the huge amount of calculation of deep neural network has been restricting its faster development and wider application. When considering the use of accelerator design to accelerate the operation of deep neural networks, the huge amount of calculation will inevitably bring a lot of energy consumption, which also restricts the further wide application of accelerators. [0003] In the operation of the neural network, it mainly includes two parts, forward s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/08
CPCG06N3/08G06N3/063G06N3/045G06N3/04
Inventor 不公告发明人
Owner SHANGHAI CAMBRICON INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap