Data standardization processing method and device, electronic equipment and storage medium

A technology for standardized processing and data storage, applied in the field of neural networks, it can solve the problems of high power consumption and long delay in the calculation process, and achieve the effect of reducing computing power consumption and shortening computing delay.

Pending Publication Date: 2022-04-15
GUANGDONG OPPO MOBILE TELECOMM CORP LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The whole process needs to read all the data in the data set from the memory three times, resulting in long delay and high power consumption of the whole calculation process.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data standardization processing method and device, electronic equipment and storage medium
  • Data standardization processing method and device, electronic equipment and storage medium
  • Data standardization processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to understand the characteristics and technical contents of the embodiments of the present application in more detail, the implementation of the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings. The attached drawings are only for reference and description, and are not intended to limit the embodiments of the present application.

[0029] figure 2 It is the first schematic flow chart of the data standardization processing method in the embodiment of the present application, such as figure 2 As shown, the method may specifically include:

[0030] Step 201: Obtain the data in the dataset;

[0031] Here, the data set can be any data set that needs to be standardized. For example, when a neural network performs image processing, the data set can be image data, and the calculation results of each layer of the neural network can form a data set. If the current layer is a standardized calculation...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention disclose a data standardization processing method and apparatus, an electronic device and a storage medium. The method comprises the steps of obtaining data in a data set; storing the data in the data set into a first storage unit, and calculating an intermediate result by using the currently obtained data; after determining that all data in the data set is stored in the first storage unit, calculating a mean value and a standard deviation of the data set by using the intermediate result; and performing standardization processing on the data set by using the mean value and the standard deviation to obtain a standardized data set. Therefore, after the data in the data set is obtained, the intermediate result participating in the calculation of the mean value and the standard deviation is updated online while the data is stored, and the mean value and the standard deviation of the data set can be calculated according to the intermediate result when the data transmission is completed, so that the process of reading the data from the first storage unit at least once can be omitted, the calculation time delay is shortened, and the calculation efficiency is improved. And calculation power consumption is reduced.

Description

technical field [0001] The present application relates to neural network technology, and in particular to a data standardization processing method, device, electronic equipment and storage medium. Background technique [0002] The neural network algorithm uses the formula Perform data set normalization calculations. where u represents the mean of the data set and x i Indicates the data in the data set, and σ represents the standard deviation of the data set. Since it is necessary to calculate the mean and standard deviation of all the data in the data set during the calculation process, the process is relatively cumbersome. During this process, the memory needs to be accessed multiple times to calculate the mean and standard deviation. Such as figure 1 As shown in , the data set obtained by the previous calculation layer of the neural network is stored in the memory. At this time, if the current layer is a standardized calculation layer, the data set of the previous lay...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F7/575G06F16/23G06F17/10
CPCG06F16/23G06F3/06G06F7/575G06F17/10
Inventor 祝叶华孙炜王波
Owner GUANGDONG OPPO MOBILE TELECOMM CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products