Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for mining data

A data and quantitative technology, applied in the fields of computer, artificial intelligence deep learning and image processing, can solve the problems of insufficient data, difficult to guarantee the accuracy of the model, and difficulty in ensuring the accuracy of the model, so as to reduce the use, reduce the cost and improve the model learning effect of ability

Active Publication Date: 2020-10-13
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since data mining is usually required in scenarios where the data is insufficient, the accuracy of the model is difficult to guarantee, so it is difficult to guarantee the accuracy of this data mining strategy.
However, the purity of accurate data is not high enough to affect the final indicators of the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for mining data
  • Method and device for mining data
  • Method and device for mining data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0019] figure 1 An exemplary system architecture 100 to which the method for mining data and the device for mining data of the embodiments of the present application can be applied is shown.

[0020] Such as figure 1 As shown, the system architecture 100 may include terminals 101 and 102 , a network 103 , a database server 104 and a server 105 . The network 103 is...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and device for mining data, and relates to the field of artificial intelligence deep learning and image processing. The specific implementation scheme is as follows: obtaining at least two trained models with different structures; predicting the sample image to be signed by using at least two models with different structures to obtain at least two prediction results; determining the number of types of prediction results in the at least two prediction results; and if the type number is greater than the preset value, determining the sample image as a difficult sample. According to the embodiment, automatic mining of difficult samples is realized.

Description

technical field [0001] The embodiments of the present disclosure relate to the field of computer technology, and specifically to the fields of deep learning of artificial intelligence and image processing. Background technique [0002] Deep learning, one of the machine learning technologies and research fields, requires a lot of computing resources and data. In practical applications, most of the time the training data needs to be labeled. In the process of training the iterative model, we found that a large part of the sample data in the training data is easy to judge for the model, and these sample data that are easy to judge are useless or useless for the training of the model. The use is extremely small; at the same time, the labeling of these sample data takes a high cost. [0003] Manually labeling data is expensive and difficult to collect data on a large scale. Data is typically mined by model-predicted labels. However, since data mining is usually required in sc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/00G06N3/04G06N3/08G06K9/62G06F16/2458
CPCG06N20/00G06N3/08G06F16/2465G06N3/045G06F18/24G06F18/214Y02D10/00
Inventor 魏凯杨敏崔程
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products