Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Instance retrieval method based on depth activation salient region

A region and depth technology, applied in the field of instance retrieval based on depth-activated salient regions, to achieve the effect of improving practicability, portability and portability, and avoiding the training process

Pending Publication Date: 2020-11-10
XIAMEN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to use depth-activated salient regions to solve the problem of locating instances of unknown categories, improve the robustness of instance object types in instance retrieval tasks, and provide solutions that can be applied to intelligent product retrieval, video editing, and other fields. An Instance Retrieval Method Based on Depth Activation Salient Regions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Instance retrieval method based on depth activation salient region
  • Instance retrieval method based on depth activation salient region
  • Instance retrieval method based on depth activation salient region

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The following embodiments will further illustrate the present invention in conjunction with the accompanying drawings.

[0025] Embodiments of the present invention include the following steps:

[0026] 1) model design: the model of the present invention is as figure 1 . exist figure 1 Contains three main modules, forward propagation module 1, pattern localization module 2 and feature extraction module 3, forming a sequential structure in turn. The forward propagation module mines the depth pattern, which is the first part of the model; the pattern localization module is mainly responsible for activating salient regions and performing region shape estimation to locate instances, which is the second part of the model; the feature extraction module extracts instance-level The features of are the third part of the model. The model takes database images as input, and obtains all instance locations and corresponding instance-level features as database features. Afterwar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an instance retrieval method based on a deep activation salient region, and relates to visual instance retrieval. The method comprises the following steps: 1) performing modeldesign: a model comprises a forward propagation module, a mode positioning module and a feature extraction module; 2) for a given image database, taking each picture in the database as the input of the model, and extracting an output instance positioning result and a corresponding instance-level feature; 3) for each query picture, taking the query picture as input of a forward propagation part ofa depth mode mining module, extracting regional instance features, and performing similarity comparison on the instance features and all instance-level features extracted from the database picture bythe model to obtain a similarity comparison result; wherein the area with the highest similarity in each database picture is the result of instance retrieval on the picture, the similarity corresponding to the area is the similarity of each picture, all pictures in the database are sequentially arranged from high to low according to the similarity, and the result of instance retrieval of the wholedatabase is obtained. The invention can be applied to intelligent retrieval and video editing of video media.

Description

technical field [0001] The invention relates to visual instance retrieval, in particular to an instance retrieval method based on depth-activated salient regions, which can be applied to Internet companies, intelligent retrieval of video media, video editing and other fields. Background technique [0002] Visual instance retrieval (hereafter referred to as "instance retrieval") is often viewed as a subtask of image retrieval. The retrieved object is a visual instance, usually given in the query image in the form of a box annotation. For example, to retrieve a specific person or a specific car. Instance retrieval needs to find out the picture containing the query instance in the image database, and give the location of the instance in the picture. Instance retrieval can be widely used in intelligent product retrieval, video editing and other fields. It is a common and basic technology in the current image data processing field to support tasks related to the instance by ret...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/532G06F16/55G06N3/04G06N3/08
CPCG06F16/532G06F16/55G06N3/084G06N3/045
Inventor 赵万磊肖惠楚王菡子
Owner XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products