Mouse cursor control method and system based on gesture recognition

A mouse cursor and gesture recognition technology, applied in the field of image processing technology and human-computer interaction, can solve problems such as reducing the recognition rate, and achieve the effects of accurate detection and recognition, and flexible operation

Active Publication Date: 2020-11-10
FUZHOU UNIVERSITY
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Studies have shown that gestures of different scales, angles, gray scales and positions all reduce the recognition rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mouse cursor control method and system based on gesture recognition
  • Mouse cursor control method and system based on gesture recognition
  • Mouse cursor control method and system based on gesture recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0056] It should be pointed out that the following detailed description is exemplary and intended to provide further explanation to the present application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

[0057] It should be noted that the terminology used here is only for describing specific implementations, and is not intended to limit the exemplary implementations according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural, and it should also be understood that when the terms "comprising" and / or "comprising" are used in this specification, they mean There are features, steps, operations, means, components and / or combinatio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a mouse cursor control method and system based on gesture recognition, and the method comprises the steps: employing MATLAB to call a built-in camera of a computer or an external USB camera to collect video data, detecting and recognizing the gesture of a person in a video, and controlling the cursor to move or click in real time according to the gesture. A gesture image recognition method integrated with a PHOG (Pyramid Histogram of Oriented Grants) feature and an improved LBP (Local Binary Pattern) feature based on a KNN (k nearest neighbor classification) classifieris proposed. In order to improve the real-time performance of system operation, the system determines whether a human hand exists in the current frame through skin color detection. When a human handis detected, PHOG features and improved LBP features are extracted. And after the PHOG features and the improved LBP features are fused, a KNN classifier is adopted to realize gesture classification and recognition. User gestures can be quickly and accurately recognized under the complex background conditions of different angles, different light rays and the like, and the action of the mouse cursor is accurately controlled in real time according to the recognition result.

Description

technical field [0001] The invention relates to the technical field of image processing and the field of human-computer interaction, and relates to a mouse cursor control method and system based on gesture recognition. Background technique [0002] Gesture recognition technology is one of the important research contents in the field of human-computer interaction. Gesture recognition technology allows for more natural and efficient control of computer equipment and robots. It breaks through the limitations of traditional human-computer interaction such as keyboard, mouse, and remote control, and greatly improves the friendliness of human-computer interaction. [0003] The development of gesture recognition has gone through two stages. The first stage is gesture recognition technology represented by wearable devices. Many sensors are installed in these devices. The second stage is gesture recognition technology based on computer vision. In the second stage, electronic dev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G06K9/34G06K9/40G06K9/46G06K9/62
CPCG06F3/017G06V40/28G06V10/267G06V10/30G06V10/50G06F18/24G06F18/253
Inventor 陈康易金王俊林瑞全欧明敏武义邢新华赵显煜李振嘉郑炜
Owner FUZHOU UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products