Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Data processing method and device

A data processing and processor technology, applied in the field of data processing methods and devices, can solve the problems of image data taking a long time, taking a long time, limited transmission bandwidth, etc.

Pending Publication Date: 2021-02-02
BEIJING SANKUAI ONLINE TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Due to the large amount of data such as image data and CNN calculation results, loading them from DDR SDRAM to TPU requires high bandwidth to support data transmission. Due to the limited transmission bandwidth between DDR SDRAM and TPU, data loading requires It takes a long time, and because the computing power is positively correlated with the demand for bandwidth, when the bandwidth is limited, the computing resources in the TPU cannot be used effectively, and the computing speed of the TPU is low, which causes the TPU to target the image data. Detection takes a long time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, technical solution and advantages of this specification clearer, the technical solution of this specification will be clearly and completely described below in conjunction with specific embodiments of this specification and corresponding drawings. Apparently, the described embodiments are only some of the embodiments in this specification, not all of them. Based on the embodiments in this specification, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this specification.

[0051] In the process of using the machine learning model to process image data in the underlying hardware, the cooperation between the processor and the memory is required as hardware support. Generally, the processor may include a graphics processing unit (Graphics Processing Unit, GPU), a tensor processing unit (Tensor Processing Unit, TPU), a field programmable logic gate array (Field P...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and device, a processor can comprise a cache module and a plurality of logic modules, the processor can obtain image data collected by an image sensorand store the image data in the cache module, and when the image data is processed through a data processing model, for each layer of the data processing model, the data processing module processes the image data. Model parameters of the layer are acquired, the model parameters are loaded to each logic module, an intermediate image obtained from the upper layer of the layer is acquired from the cache module, the intermediate image is segmented to obtain each sub intermediate image, each sub intermediate image is loaded to each logic module, operation on the model parameters and each sub intermediate image are performed through each logic module to obtain a plurality of sub intermediate images, an intermediate image obtained by the layer is acquired, and the intermediate image is stored ina cache module. By means of the method, the image data or the intermediate images obtained in all the layers are stored in the cache, the problem that the data transmission bandwidth is limited is solved, computing power resources of the processor are effectively used, and the effect of reducing time consumption is achieved.

Description

technical field [0001] This specification relates to the technical field of machine learning, and in particular to a data processing method and device. Background technique [0002] At present, in terms of hardware support, the operation of machine learning models can be realized through processors and memories. The processor may include a graphics processing unit (Graphics Processing Unit, GPU), a tensor processing unit (Tensor Processing Unit, TPU), etc., and the memory may include, for example, double data rate synchronous dynamic random access memory (Double Data Rate Synchronous Dynamic Random Access Memory, DDR SDRAM) and other memory components. [0003] Taking target detection on image data and the machine learning model as a Convolutional Neural Networks (CNN) model as an example, the image data, CNN model parameters, and the calculation results of each layer of CNN can be stored in DDR SDRAM. For TPU For the operation of any layer in CNN, first load the CNN model...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T1/60G06N3/063G06N3/04G06N3/08
CPCG06T1/60G06N3/063G06T2200/28G06N3/08G06N3/045
Inventor 柴双林
Owner BEIJING SANKUAI ONLINE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products