Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Static gesture recognizing method and system for AR auxiliary maintenance

A gesture recognition and augmented reality technology, applied in the field of gesture recognition, can solve problems that affect the flexibility of manual operation and the efficiency of maintenance support

Inactive Publication Date: 2016-09-21
ORDNANCE TECH RES INST OF THE GENERAL ARMAMENT DEPT PLA
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, many augmented reality assisted maintenance systems use auxiliary means such as wearing color markers or data gloves to recognize hand movements in order to improve the gesture recognition rate, and this method directly affects the flexibility of manual operation and the efficiency of maintenance support in the maintenance process.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Static gesture recognizing method and system for AR auxiliary maintenance
  • Static gesture recognizing method and system for AR auxiliary maintenance
  • Static gesture recognizing method and system for AR auxiliary maintenance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] Embodiment 1, a static gesture recognition method for augmented reality assisted maintenance.

[0063] Such as figure 1 As shown, the static gesture recognition method for augmented reality assisted maintenance provided by the present invention includes the following steps:

[0064] S1. Collect video images and perform frame separation to obtain test samples.

[0065] Utilize video camera to collect video image under the background of camouflage outfit or circuit board and carry out frame separation to it, make all the image frames that contain and not contain gesture information be separated from video image, form image frame sequence, collect 1000 in the present embodiment image as a test sample to be processed.

[0066] S2. Perform gesture and background segmentation on each frame of image in the test sample.

[0067] Segment the gesture and background in the image, specifically: according to the skin color range method, judge each pixel in the image one by one; i...

Embodiment 2

[0110] Embodiment 2, a static gesture recognition system for augmented reality assisted maintenance.

[0111] Such as Figure 5 As shown, the static gesture recognition system for augmented reality assisted maintenance provided by the present invention includes an image acquisition module 1 , a gesture segmentation module 2 , a vector construction module 3 , a vector normalization module 4 and a gesture recognition module 5 .

[0112] The image acquisition module 1 is connected with the gesture segmentation module 2, which is used to collect video images through a camera, and perform frame separation on the collected video images to obtain several frames of images, and these images constitute test samples. When the image acquisition module 1 collects video images through a camera, it generally uses a camouflage outfit or a circuit board as a background.

[0113] The gesture segmentation module 2 is connected with the image acquisition module 1 and the vector construction modu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a static gesture recognizing method and system for AR auxiliary maintenance. The method specifically comprises the following steps of: acquiring a video image and performing frame separation to obtain a test sample; separating a gesture from a background of an image in the test sample by using a skin color range method; creating a static gesture feature input vector corresponding to the image in the test sample and normalizing the vector; inputting the normalized the vector into a support vector machine and enabling a classifier in the support vector machine to recognize the gesture for acquiring an optimal classification solution of the static gesture. The method forms the eight-dimension composite characteristic input vector of the static gesture by the seven-order invariant moment of Hu and image normalization moment of inertia (NMI) so as to achieve better robustness for image translation, rotation, and zooming, fully takes account of the influence of illumination, background, and gesture orientation, increases the accuracy of training samples in the support vector machine, and increases recognition precision.

Description

technical field [0001] The invention relates to the technical field of gesture recognition, in particular to a static gesture recognition method and system for augmented reality assisted maintenance. Background technique [0002] At present, the usability of the augmented reality assisted maintenance system is not only reflected in its robustness, but also in its ability to interact with users. The development direction of the augmented reality assisted maintenance system should try to use gestures or direct interaction with human behavior instead of Use an indirect input device. This can make the maintenance process closer to nature, more realistic and rich, and provide convenient conditions for efficient equipment design, testing, repair, maintenance, etc., so as to realize user-centered human-computer interaction. Therefore, it is of great significance to carry out research on static gesture recognition technology for augmented reality assisted maintenance system. [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/113G06F18/2411
Inventor 李欣张勇周斌马东玺王伟明赵守伟
Owner ORDNANCE TECH RES INST OF THE GENERAL ARMAMENT DEPT PLA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com