Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image semantic description generation method

A semantic description, image technology, applied in biological neural network models, instruments, character and pattern recognition, etc., can solve problems such as inability to determine the focus of images

Pending Publication Date: 2019-08-30
CHINA UNIV OF MINING & TECH
View PDF6 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, due to the great difference between the underlying visual features of the image and the high-level semantic concepts, there are still many problems to be solved in the current image scene semantic description method. For example, it is impossible to determine the focus of the image to mine higher-level semantic information. And improve the details of the description of the sentence and other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image semantic description generation method
  • Image semantic description generation method
  • Image semantic description generation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] Preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of the application and together with the embodiments of the present invention are used to explain the principle of the present invention and are not intended to limit the scope of the present invention.

[0065] A specific embodiment of the present invention, such as figure 1 As shown, a method for generating an image semantic description is disclosed, which includes the following steps:

[0066] S1, extracting the global features and local features of the image;

[0067] S2. Combine the global feature and the local feature to obtain combination information;

[0068] S3, generate a semantic description model by focusing on the image features and the focused text according to the combined information through an adaptive attention mechanism, and generate words and sentences for the semantic des...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image semantic description generation method, and belongs to the technical field of image semantic description. The method comprises the following steps: S1, extracting global features and local features of an image; S2, combining the global features and the local features to obtain combined information; and S3, focusing image features and focusing texts according to the combination information through an adaptive attention mechanism to generate a semantic description model, and generating words and phrases of image semantic description by utilizing the semantic description model. According to the method, the problems that the focus key point of the image is determined, higher-level semantic information is mined, and detail information describing words or sentences is perfected in the existing image semantic description technology are solved.

Description

technical field [0001] The invention relates to the technical field of image semantic description, in particular to a method for generating image semantic description. Background technique [0002] With the rapid development of artificial intelligence and breakthroughs in deep learning technology, computer vision technology based on deep learning is becoming more and more mature. Researchers are trying to make machines understand more complex semantic information in visual information. Therefore, at the intersection of computer vision and natural language processing The research direction of image semantic description appears in the field. The image semantic description technology was first proposed by Farhadi et al. Its goal is to realize the conversion of images in visual space to text descriptions in semantic space. The method realizes the mapping from images to text description sentences, gives semantic interpretation to visual data, and realizes Space to semantic space...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/46G06N3/04
CPCG06N3/049G06V10/462G06N3/045
Inventor 赵小虎有鹏尹良飞李祎宸刘勇
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com