Index modelling with deep learning characteristic

An exponential model, machine learning technology, applied in the field of machine learning, can solve the problem that the effective solution has not yet been determined

Pending Publication Date: 2020-02-14
GOOGLE LLC
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, to date, efficient solutions to achieve compression gains have not been identified

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Index modelling with deep learning characteristic
  • Index modelling with deep learning characteristic
  • Index modelling with deep learning characteristic

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] overview

[0047]In general, the present disclosure is directed to machine learning models that exploit the benefits provided by the combination of deep learning and exponential modeling structures (eg, maximum entropy models). More specifically, as mentioned above, one of the main reasons that maximum entropy modeling has been replaced as a learning algorithm is that the features to be used by maximum entropy models are handcrafted and, unlike neural networks, not learned automatically. However, this disclosure demonstrates that exponential modeling techniques such as maximum entropy modeling can be combined with deep learning modeling to achieve a unique combination of benefits.

[0048] In particular, for many tasks, deep learning models often end with softmax layers, which are used for classification or conditional estimation of probabilities. However, according to an aspect of the present disclosure, the benefits of both forms of modeling can be realized if inst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An artificially designated relationship can assist the realization of mapping, which can compress the output structure of a machine learning model. For example, an index model of a maximal entropy model can utilize machine learning embedding and mapping to generate classified output. In this way, the feature finding function of a machine learning model (for example, deep networks) and relationship, which is developed based on the people's understanding of structural properties of a problem to be solved, are cooperatively combined to compress the output structure of the model without generatingobvious precision loss. These compressed models improve the adaptability of the models in facilities or other resource limited scenes.

Description

[0001] priority claim [0002] This application claims priority to U.S. Patent Application Serial No. 62 / 752,128, filed October 29, 2018, entitled "Exponential Modeling with Deep Learning Features," the entire disclosure of which is incorporated herein by reference. technical field [0003] This disclosure relates generally to machine learning. More specifically, the present disclosure relates to machine learning models, including exponential models (eg, maximum entropy models) that exploit the mapping between output classes and embedding parameters to provide compression gains. Background technique [0004] Various forms of machine learning models have revolutionized many areas of machine intelligence. As an early example, at some point in the past, maximum entropy models provided state-of-the-art performance in natural language processing and other technical domains. Maximum entropy models follow the principle that the model should provide as few biased estimates as poss...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06N20/00
CPCG06N3/084G06N20/00G06N3/045G06F18/2415G06N3/082G06N3/063G06N20/10G06N3/048G06N3/044G06F18/2431
Inventor M.温特劳布A.T.苏雷什E.瓦里亚尼
Owner GOOGLE LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products