Activation function hybrid calculation method and system based on CORDIC

A hybrid computing and activation function technology, applied in the field of functional computing, can solve problems such as low precision and difficult expansion of computing range, and achieve the effects of expanding data range, reducing computing resource overhead, and low power consumption

Pending Publication Date: 2020-02-07
南京宁麒智能计算芯片研究院有限公司
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to overcome the disadvantages of the prior art that the calculation results of the sigmoid function and the tanh function have low accuracy and the calculation range is not easy to expand, and provide a CORDIC-based activation function hybrid calculation method and system, which can improve the sigmoid function and the tanh function. Calculation accuracy, and can expand the data range and reduce computing resource overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Activation function hybrid calculation method and system based on CORDIC
  • Activation function hybrid calculation method and system based on CORDIC
  • Activation function hybrid calculation method and system based on CORDIC

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] combine figure 1 and figure 2 As shown, a CORDIC-based activation function hybrid calculation method of the present invention is used to calculate the sigmoid function and the tanh function, and can improve the calculation accuracy of the sigmoid function and the tanh function and expand the calculation range. It should be noted that, because T(x) represents the tanh function, and S(x) represents the sigmoid function; the present invention utilizes the hyperbolic rotation mode CORDIC module to calculate e -x or e 2x , and using the linear vector mode CORDIC module to calculate or Finally, the result of the sigmoid function or tanh function is obtained by shifting or addition and subtraction.

[0045] A CORDIC-based activation function hybrid calculation method of the present invention, first input the value x to be evaluated and the calculation type t to the core control module, and the core control module processes the value x to be evaluated according to th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an activation function hybrid calculation method and system based on CORDIC, and belongs to the technical field of function calculation. The method comprises: a core control module processing a to-be-evaluated x according to a calculation type t to obtain an input value a and inputting the input value a into a hyperbolic rotation mode CORDIC module; performing operation according to the input value a to obtain xn and yn, adding the xn and yn through an adder to obtain an input value b, inputting the input value b into a linear vector mode CORDIC module for division operation to obtain z'n, and processing and outputting the z'n according to the calculation type t. The system comprises a core control module, a hyperbolic rotation mode CORDIC module and a linear vectormode CORDIC module, wherein the hyperbolic rotation mode CORDIC module and the linear vector mode CORDIC module are respectively connected with the core control module. The method aims to overcome the defects that in the prior art, the sigmoid function and the tanh function are low in calculation precision and the calculation range is not easy to expand, the calculation precision of the sigmoid function and the tanh function can be improved, and the data range can be expanded.

Description

technical field [0001] The present invention relates to the technical field of function calculation, and more specifically, to a CORDIC-based activation function hybrid calculation method and system. Background technique [0002] CORDIC (CoordinateRotationDigitalComputer), that is, coordinate rotation digital computer, can be widely used in the calculation of basic functions, including exponential functions, division and other operations. It was first proposed by J.D.Volder in 1959. Later, J.Walter proposed a unified CORDIC algorithm in 1971; in 2004, Tso-BingJuang et al. proposed an improved parallel CORDIC algorithm, which greatly improved the iteration speed of the CORDIC algorithm and achieved high accuracy. . Its advantage is that it only balances important hardware indicators such as calculation accuracy, area and speed through shifting and addition and subtraction operations, so it is widely used in digital signal processing and other fields. The CORDIC algorithm h...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/04G06F17/15
CPCG06F17/15G06N3/048
Inventor 李丽陈辉傅玉祥程开丰何书专
Owner 南京宁麒智能计算芯片研究院有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap