Target tracking method based on natural language information assistance

A natural language and target tracking technology, applied in the field of target tracking based on natural language information, can solve the problems of insufficient features and lack of semantic information description, so as to overcome the insensitivity of semantic information, reduce mistracking or target drift, and improve efficiency effect

Pending Publication Date: 2021-03-16
深圳龙岗智能视听研究院
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For the current problems in the tracking field, the main reason is that the features are not strong enough, and there is a lack of higher-level semantic information to describe the tracking target.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Target tracking method based on natural language information assistance
  • Target tracking method based on natural language information assistance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The object tracking method based on natural language information assistance of the present invention relates to a method for single object tracking in a video sequence, which uses natural language information as an auxiliary object tracking mode, and increases the number of objects in the video sequence tracking process. The natural language description of the target, these semantic descriptions can increase the high-level semantic information in the tracking process, making the target tracking more accurate.

[0020] The target tracking method of the present invention uses natural language information as an auxiliary, and can combine natural language information and visual information to track targets. The method of fusion of these features greatly expands the detectable range and accuracy. Finally, the long-term effective features provided by natural language information are used to correct the target features, which improves the effective duration of target tracking ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a target tracking method based on natural language information assistance. The method comprises the steps: carrying out the description of visual features and natural language features of an image, and extracting the visual features of a target and a candidate region and the natural language features for describing the target; constructing a visual tracking model based on the initial visual features, and constructing a natural language response model based on the initial natural language tracking model; and determining a response of the visual feature by using the imagefeature detector fused with the multi-layer features, and detecting the candidate image by using the natural language feature detector while acquiring a response of the candidate image to the naturallanguage feature. According to the method, the advantages of natural language information and visual information are combined, high-level semantic features provided by a natural language are used forassisting visual features, and target tracking is more stable.

Description

technical field [0001] The invention relates to the technical field of computer target tracking, in particular to a target tracking method based on natural language information assistance. Background technique [0002] Target tracking is one of the popular fields of computer vision research, which refers to automatically tracking a fixed target appearing in a continuous video frame by using artificial intelligence technology in a continuous video frame. As a basic technology, object tracking is widely used in various fields, such as autonomous driving, smart city and intelligent monitoring and other scenarios. [0003] Object tracking is a challenging computer vision task. For a moving object in a video, the moving scene of the object is easy to change, and the object itself is constantly changing during the movement. These changes bring many challenges to object tracking. Among them, there are two common challenges: occlusion challenge, which means that the target is part...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/246G06K9/62
CPCG06T7/248G06T2207/10016G06T2207/20084G06F18/253
Inventor 张世雄李楠楠龙仕强朱鑫懿魏文应
Owner 深圳龙岗智能视听研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap