Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Operator fusion method for neural network and related product thereof

A fusion method, neural network technology, applied in biological neural network model, neural architecture, physical implementation, etc., to reduce execution time and memory access.

Active Publication Date: 2019-11-22
CAMBRICON TECH CO LTD
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, memory access is currently a serious bottleneck in the execution of neural networks by AI processors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Operator fusion method for neural network and related product thereof
  • Operator fusion method for neural network and related product thereof
  • Operator fusion method for neural network and related product thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In the following, only some exemplary embodiments are briefly described. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present disclosure. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature and not restrictive.

[0038] The following will clearly and completely describe the technical solutions in the embodiments of the present disclosure with reference to the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of them. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present disclosure.

[0039] It should be understood that the terms "first", "second", "third" and "fourth" in the claims, s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an operator fusion method for a neural network and a related product, and the method comprises the steps: traversing operators in a calculation graph corresponding to the neural network, and selecting a current operator and a to-be-fused operator from the calculation graph; splitting the output data of the operator to be fused into a plurality of output blocks according toa splitting size; based on the output block, mapping to obtain a data block size of input data of the current operator corresponding to the output block and a data block size of intermediate data between the current operator and an operator to be fused; and based on the splitting size, the data block size of the input data of the current operator and the data block size of the intermediate data between the current operator and the operator to be fused, judging whether the current operator and the operator to be fused are fused together or not.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, and in particular to an operator fusion method and a computer-readable storage medium applicable to neural networks. Background technique [0002] Neural Networks (DNNs) are increasingly used in various applications, such as speech recognition, object detection, semantic segmentation, etc. With the continuous development of neural network technology, the number of neurons and synapsis is increasing exponentially. Therefore, the amount of computing operations and memory access also increases rapidly, far exceeding the processing capability of hardware, especially for embedded systems, the problem is particularly serious. The industry has proposed some solutions, such as: pruning, data compression, low-precision quantization, etc. However, the existing general-purpose processor platforms (such as CPU, FPGA, DSP, etc.) are still difficult to fully meet the requirements of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/06G06N3/04
CPCG06N3/061G06N3/045
Inventor 不公告发明人
Owner CAMBRICON TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com