Optimization problem processing method and device for machine learning

A machine learning and optimization technology, applied in the field of optimization, can solve problems affecting the training process of machine learning, etc.

Inactive Publication Date: 2021-05-11
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] There is currently no effective solution to the problem in the prior art that the gradient of the objective function disappears and affects the training process of machine learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Optimization problem processing method and device for machine learning
  • Optimization problem processing method and device for machine learning
  • Optimization problem processing method and device for machine learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0039] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

[0040] Based on the above purpose, the first aspect of the embodiments of the present invention proposes an embodiment of an optimization problem processing method for processing the optimal solution problem of a non-differentiable function in machin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an optimization problem processing method and device for machine learning. The method comprises the steps: determining an objective function and a constraint condition according to a to-be-solved problem, and continuing a next step in response to the fact that the objective function is a non-differentiable convex function; updating the current solution by using a projection subgradient method based on the number of iterations and the constraint condition, and substituting the current solution into the target function to obtain a current function value; in response to the fact that the current function value does not meet the convergence condition and the number of iterations does not exceed the preset upper limit, accumulating the number of iterations and re-executing the previous step; and determining a solution corresponding to an optimal value in the current function values as an optimal solution of the to-be-solved problem in response to the condition that the current function values meet the convergence condition or the number of iterations exceeds a preset upper limit. According to the method, the optimal solution problem of the non-differentiable function of machine learning can be solved, and the convergence speed is very high.

Description

technical field [0001] The present invention relates to the field of optimization, more specifically, a method and device for processing optimization problems of machine learning. Background technique [0002] In the field of machine learning, optimization theory is the most important. The main reason is that machine learning often abstracts the problem into an optimization problem, such as maximizing rewards, minimizing losses caused by classification errors, or maximizing likelihood, etc., and how to solve these problems requires corresponding optimization algorithms. The current mainstream algorithm is SGD, and many variants of SGD, including Momentum, AdaGrad, RMSProp, Adam, etc. What these algorithms have in common is that they all need to calculate the gradient value of the objective function, but in practical applications, the gradient does not necessarily exist, and it is easy for the gradient to disappear during the training process. Therefore, how to solve the pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/00G06F17/16
CPCG06F17/16G06N20/00
Inventor 刘鑫
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap