Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image retrieval method based on deep convolution characteristic and semantic similarity measurement

A technology of image retrieval and deep convolution, applied in character and pattern recognition, special data processing applications, instruments, etc., can solve the problems of inaccurate and comprehensive description of image similarity, achieve high retrieval accuracy rate, and good semantic similarity performance, strong robustness

Active Publication Date: 2018-11-27
YUNNAN NORMAL UNIV
View PDF7 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Obviously, this method only considers the similarity relationship between two images and ignores the similarity structure inside the image, which cannot accurately and comprehensively describe the true similarity between images.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image retrieval method based on deep convolution characteristic and semantic similarity measurement
  • Image retrieval method based on deep convolution characteristic and semantic similarity measurement
  • Image retrieval method based on deep convolution characteristic and semantic similarity measurement

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0087] Embodiment 1: as figure 1 As shown, an image retrieval method based on deep convolution features and semantic similarity measurement, this embodiment takes an image set composed of 1000 images as an example, each image is used as a query image, by obtaining each query The similarity of an image to other images in the database is used to complete the retrieval. The specific process includes: extracting the deep convolution features and reduction of all images (Step1), performing AFS semantic description of image features (Step2), calculating the semantic similarity between images (Step3), sorting and completing according to the similarity Image retrieval (Step4).

[0088] The concrete steps of described image retrieval method are as follows:

[0089] Step1, image feature extraction.

[0090] Step1.1, normalize the size of the image to the size of 224*224;

[0091] Step1.2. Using the MatConvNet toolbox, the image is used as the input of the VGG-verydeep-16 network mod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image retrieval method based on deep convolution characteristic and semantic similarity measurement, and belongs to the correlation fields such as computer vision, image processing and image understanding. Firstly, aiming at an image set, convolution layer characteristics of each image are extracted through a trained deep convolution neutral network mode, the extractedconvolution layer characteristics are subjected to polymerization representation, the convolution layer characteristics are subjected to semantic description through an AFS framework, an image similarity measuring method based on semantic similarity is defined on the basis, the similarity of images in an image library are calculated, and finally the similarity is ranked to complete an image retrieval task. The problems that a traditional retrieval method based on bottom layer visual characteristics currently is in lack of semantic and low in accuracy can be effectively solved, and the actual requirements of users on image retrieval based on content are better met.

Description

technical field [0001] The invention relates to an image retrieval method based on deep convolution features and semantic similarity measurement, and belongs to the technical field of computer image retrieval. Background technique [0002] Content based image retrieval (Content based Image Retrieval, CBIR) has always been one of the research hotspots in the field of computer vision. With the rapid increase of multimedia information in the Internet age, how to quickly and accurately retrieve images that meet user requirements from massive image data covering various contents is a very challenging task. In CBIR, image feature extraction and image similarity measurement are two key links. [0003] In recent years, with the successful application of deep learning technology in the field of image recognition, convolutional neural networks (CNNs) have been used as a feature extraction method to obtain deep convolutional features with high-level semantics, so as to improve the acc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06K9/62G06N3/04
CPCG06N3/045G06F18/2135
Inventor 周菊香张姝王俊徐坚
Owner YUNNAN NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products