Gesture recognition method and device

A gesture recognition and camera technology, applied in the field of virtual reality, can solve problems such as large amount of image processing calculations, failure to realize effective information input, and inability to recognize mobile devices, so as to improve experience, reduce image processing calculations, and realize The effect of inputting valid information

Active Publication Date: 2020-11-06
BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF9 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the related art, gesture recognition can be used to determine the information input by the user. According to the gesture recognition process of the related art, the mobile device needs to analyze and process the image collected by the camera device to determine the hand position of the target user, and then determine the hand position according to the user's hand. User gestures, the image processing of this technical solution requires a large amount of computation, and if more than one user's hand appears in the image, it may cause the mobile device to fail to recognize the target user's hand and thus fail to realize effective information input

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture recognition method and device
  • Gesture recognition method and device
  • Gesture recognition method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.

[0071] Figure 1A is a flowchart of a gesture recognition method according to an exemplary embodiment, Figure 1B is a schematic diagram of determining the depth information of each pixel point through two cameras according to an exemplary embodiment; the gesture recognition method can be applied to mobile devices (such as smart phones, tablet computers) with more than two cameras ,like Figure 1A As...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present disclosure relates to a gesture recognition method and device. The method includes: determining depth information of each pixel point in each to-be-processed image according to the to-be-processed images collected by the two or more cameras, where the depth information is used to represent the actual depth corresponding to each of the pixel points. The distance between the object point and the mobile device; the to-be-processed image area of ​​each to-be-processed image is determined according to the depth information; the target user's gesture is determined according to the image information of the to-be-processed image area. The technical solution of the present disclosure can effectively solve the problem of a large amount of image processing computations caused by processing the entire image to be processed in the related art, and solves the problem in the related art that if more than one user's hand appears in the image, effective information cannot be realized The problem of input improves the user experience of inputting information in VR.

Description

technical field [0001] The present disclosure relates to the field of virtual reality (Virtual Reality, VR) technology, and in particular, to a gesture recognition method and device. Background technique [0002] With the rapid development of virtual reality technology based on mobile devices, users can use virtual reality helmets combined with mobile devices to implement various application functions in a virtual reality environment, such as using virtual reality helmets to play online games on mobile devices. When a user uses a virtual reality headset, human-computer interaction is often involved. [0003] In the related art, gesture recognition can be used to determine the information input by the user. According to the gesture recognition process of the related art, the mobile device needs to analyze and process the images collected by the camera device to determine the hand position of the target user and then determine according to the user's hand. User gesture, the i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01
CPCG06F3/017G06F16/5838G06V40/117G06V40/10G06V40/28G06T7/55
Inventor 林形省
Owner BEIJING XIAOMI MOBILE SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products