Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Circuit for realizing activation function and processor comprising circuit

A function computing and computing circuit technology, applied in the field of neural network computing circuit design, can solve problems such as poor computing performance, affecting neural network training and reasoning speed, and failure to see the integration of activation functions, so as to increase the scope of application and simplify Effect of circuit design and speed improvement

Pending Publication Date: 2021-06-04
ALIBABA GRP HLDG LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the field of existing technologies, activation function calculations are usually performed in a software manner. Since this method only uses conventional processor instructions for processing, when performing a large number of activation function calculations, there is a problem of poor computing performance, which significantly affects neuroscience. Network training and inference speed
[0004] In the field of existing technologies, there are also hardware acceleration solutions, but the existing hardware acceleration solutions only target one or several activation functions for hardware acceleration processing, and do not see the integration of operations of various activation functions, and Simultaneously provide a variety of hardware acceleration solutions for activation function operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Circuit for realizing activation function and processor comprising circuit
  • Circuit for realizing activation function and processor comprising circuit
  • Circuit for realizing activation function and processor comprising circuit

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0038] figure 1 A schematic diagram of a circuit design of an arithmetic circuit 100 according to an embodiment of the present invention is shown. figure 1 The illustrated circuit layout is an overall layout of the arithmetic circuit 100 . Such as figure 1 As shown, the operation circuit 100 includes an exponential operation unit 110 , a division operation unit 120 , a logistic regression (sigmoid) function operation unit 130 and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an operation circuit which is suitable for performing operation on data. The operation circuit comprises an index operation unit, a division operation unit, a logistic regression function operation unit and a selection unit. The selection unit is suitable for selecting the operation output of the index operation unit, the division operation unit or the logistic regression function operation unit as an operation result according to an operation mode. The logistic regression function operation unit is coupled to the index operation unit and the division operation unit, and is suitable for performing an index operation in the logistic regression function operation by using the index operation unit and performing a division operation in the logistic regression function operation by using the division operation unit when the logistic regression function operation is performed on the data. The invention further discloses a processor comprising the operational circuit, a system on chip and intelligent equipment.

Description

technical field [0001] The invention relates to the field of processors, in particular to circuit design for neural network operations. Background technique [0002] In the field of artificial intelligence, various neural network models have been proposed to deal with problems in image, video, audio and natural language processing. The neural network model generally includes multiple network layers, and each layer of the network has a large number of nodes. The value of each layer of nodes can be passed to the next layer of nodes and activated by the value of the previous layer of nodes. Therefore, in the neural network model, a large number of activation function calculations are required. [0003] In the field of existing technologies, activation function calculations are usually performed in a software manner. Since this method only uses conventional processor instructions for processing, when performing a large number of activation function calculations, there is a prob...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/063
CPCG06N3/063
Inventor 孙宇航
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com