Multi-computing-unit coarse-grained reconfigurable system and method for recurrent neural network

Abstract

The invention discloses a multi-computing-unit coarse-grained reconfigurable system and method for a recurrent neural network LSTM (long short-term memory). The system comprises multi-matrix-product bias and calculation arrays, activation fitting calculation arrays and vector quantity calculation arrays. The multi-matrix-product bias and calculation arrays are used for realizing calculation and accumulation operation of multiple matrix vector products in the recurrent neural network and perform addition bias calculation under control of control signals, and output values are outputted through corresponding output cache units. The activation fitting calculation arrays are used for realizing a piecewise linear fitting calculation function of activation functions in the recurrent neural network LSTM, activation fitting calculation units are controlled by the control signals to perform corresponding activation function piecewise linear fitting calculation when input values enter input cache units, and output values are outputted through corresponding output cache units. The vector quantity calculation arrays are used for realizing dimension-based vector multiplication and vector addition calculation, and after multiplication units finish calculation, data are transmitted to vector addition units or directly outputted under control of the control signals. Parallelism degree, calculation speed and array utilization rate of the reconfigurable system are increased.

Description

technical field [0001] The invention relates to a multi-computing unit coarse-grained reconfigurable system and method oriented to a recursive neural network LSTM, belonging to the field of embedded reconfigurable systems. Background technique [0002] In recent years, with the development of microelectronics technology and computer technology, especially the emergence of large-scale high-performance programmable devices, the improvement of software and hardware design methods and design tools, real-time circuit reconfiguration technology has gradually become an international computing system research. A new hotspot in . Its appearance has blurred the boundary between hardware and software in the traditional sense in the past, and made the hardware system soft. The essence of real-time circuit reconfiguration is to use the characteristics of programmable devices that can repeatedly configure the logic state, and dynamically change the circuit structure of the system accordi...

AI Technical Summary

Problems solved by technology

GPU computing has extremely high parallelism, but the program code required for GPU parallel computing is more complicated, and the process management of parallel programs also increases the workload, and GPU computing requires high power consumption; FPGA is flexible and improves digital circuit performance. Reusable power consumption is high, and the power consumption is also large; ASIC power consumption and area overhead are the smallest, and the calculation speed is the fastest, but the cost of casting is high, and it takes a long time from design to use

Images