Keyboard tracking method and system

A keyboard and key point technology, applied in the field of image processing, can solve problems such as poor user input experience, poor input experience, and slow input speed, and achieve the effects of robust lighting and noise, small occlusion effects, and improved comfort

Active Publication Date: 2022-05-27
北京影创信息科技有限公司
View PDF15 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

One is to use handles, gestures, etc. for text input. This method has problems such as slow input speed and poor user input experience.
The other is to manually calibrate the virtual keyboard and the real keyboard, and then use SLAM to track. In this way, the keyboard needs to be re-calibrated every time it moves, which is inconvenient to operate and the user input experience is poor.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Keyboard tracking method and system
  • Keyboard tracking method and system
  • Keyboard tracking method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, technical solutions and advantages of the embodiments of the present application more clearly understood, the following will clearly illustrate the spirit of the contents disclosed in the present application with the accompanying drawings and detailed description. , when it can be changed and modified by the technology taught by the content of this application, it does not depart from the spirit and scope of the content of this application.

[0051] The illustrative embodiments and descriptions of the present application are used to explain the present application, but are not intended to limit the present application. In addition, elements / members with the same or similar reference numerals used in the drawings and the embodiments are intended to represent the same or similar parts.

[0052] The "first", "second", . .

[0053] As used herein, "comprising," "including," "having," "containing," and the like, are open-ended terms, meaning i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a keyboard tracking method and system. The keyboard tracking method comprises the following steps: acquiring an image sequence containing a keyboard and a user hand image; processing the image sequence containing the keyboard image by using a deep learning algorithm to obtain coordinates of 2d key points of a keyboard, a mask of the keyboard and a mask of a hand; processing the coordinates of the 2d key points of the keyboard and the mask of the keyboard by adopting an optimization algorithm based on feature points to obtain a 3d estimated pose of the keyboard; optimizing the 3d estimated pose of the keyboard by adopting a mask-based optimization algorithm to obtain a 3d optimized pose of the keyboard; and obtaining the model information of the keyboard, and rendering the 3d pose of the keyboard with the obtained model and the mask of the hand to complete the tracking of the keyboard. According to the invention, the user can naturally use the keyboard to input, the operation is convenient, and the user experience is improved.

Description

technical field [0001] The present application belongs to the technical field of image processing, and in particular relates to a keyboard tracking method and a tracking system. Background technique [0002] Virtual reality technology is an important branch of simulation technology. It uses computer technology and various software and hardware tools to generate real-time dynamic, three-dimensional and realistic images and scenes, and can imitate various human perceptions and communicate with users. interact. Since the germination of virtual reality technology in 1963, the theory of virtual reality technology has been relatively complete, and in recent years, virtual reality technology has been widely and deeply researched and applied in many industries such as military simulation, entertainment games, medical care, and construction. [0003] In the human-computer interaction process of the existing virtual reality device, the following two ways are usually used to realize t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06T7/20G06T15/00
CPCG06F3/011G06F3/017G06T7/20G06T15/00G06T2207/10016G06T2207/30196G06T2207/20081
Inventor 张旭于天慧邓伯胜毛文涛蔡宝军
Owner 北京影创信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap