Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Target tracking method and device

A target tracking and target technology, applied in the field of computer vision, can solve problems such as poor robustness, inability to distinguish which face, target tracking failure, etc., to achieve the effect of preventing target loss and accurate target tracking ability

Pending Publication Date: 2020-12-25
HUAWEI TECH CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current methods of target tracking based on camera devices still have poor robustness in practical applications.
For example: when many people enter the field of view of the camera device, the robot will detect multiple faces, so that it cannot distinguish which face is the face to be tracked, resulting in the failure of target tracking; in addition, when the target has only part of the body In the field of view of the camera device or when the target is facing away from the robot or facing the robot sideways, the robot may not be able to detect the human face, resulting in the failure of target tracking, which may cause the camera device to be unable to track the target; When occluded, the robot will directly track the non-target face, resulting in target tracking failure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Target tracking method and device
  • Target tracking method and device
  • Target tracking method and device

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0082] Example 1: When this method is applied to educational robots and home robots, since their interactive objects are usually their owners, the target face should be the owner's face. In this case, face recognition can be achieved by Some general / commonly used face recognition algorithms are implemented, such as: local binary pattern algorithm (local binary pattern, LBP), such as FaceNet and other algorithms based on deep neural networks or convolutional neural networks, etc. These face recognition algorithms can feature-match the image with the specified face information, so that only the face of the specified person can be used as the target face. The embodiment of the present application does not limit the implementation method of using the face recognition algorithm to identify the target face. As an example, the face recognition algorithm can be as follows: Image 6 It includes four stages of face detection, face alignment, feature description and feature matching, amo...

example 2

[0087] Example 2: When this method is applied to a service robot in a public place, the first person who appears in the field of view of the camera device within a period of time can be used as the tracking target, and its face can be used as the target face; A microphone is installed on the device to detect the position of the human voice, so that the face of the user who is talking to the service robot is used as the target face.

[0088] Region of interest (ROI) refers to the area to be processed that is outlined in the form of a box, circle, ellipse, irregular polygon, etc. from the processed image in the field of machine vision and image processing. Therefore, the first region of interest is the region to be processed of the target face outlined from the T-th frame of image. For example, as Figure 7 As shown, the first ROI is a box-shaped area 141 , which may include part or all of the target face 142 , for example, the area including the eyes, nose, mouth and other parts...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a target tracking method and device, which can generate a sampling frame in a Tth frame image acquired by a camera device, the sampling frame comprises a firstarea of interest of a target face, cyclic shift is performed on the sampling frame in the Tth frame image to obtain n training samples, each training sample corresponds to a classification label. A nonlinear classifier is trained by using the n training samples and the classification labels corresponding to the n training samples, the response degree of the input samples and the first area of interest is outputted by the nonlinear classifier, and cyclic shift is performed on the sampling frame in the (T + 1) th frame of image to obtain n shift samples, A target sample is determined with the highest response degree with the first area of interest from the n shift samples by using a nonlinear classifier, the first area of interest is updated according to the target sample, and the visual angle of the camera device is adjusted according to the position of the first area of interest. The technical scheme can adapt to scenes such as multiple faces and high dynamics in the visual field of the camera device, and is high in robustness.

Description

technical field [0001] The present application relates to the technical field of computer vision, and in particular to a method and device for object tracking. Background technique [0002] Robots can generally refer to man-made devices that have the ability to work semi-autonomously or fully autonomously and complete human work, such as household robots for personal or family use, food delivery robots in hotels, and guidance robots in hospitals and other places. Welcome robots in bank halls and security robots in public places, etc. [0003] The robot uses its camera device to collect images of the user, judges the user's position, and adjusts the direction of the camera device according to the user's position, so that the camera device always faces the user when interacting with the user, and realizes target tracking for the user. However, the current method of object tracking based on the camera device still has the problem of poor robustness in practical applications. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/32G06K9/00G06K9/62G06T7/20H04N5/232
CPCG06T7/20G06V40/16G06V20/10G06V10/25H04N23/611G06F18/214G06F18/24
Inventor 王凯薛景涛贺亚农陈辰
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products