Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Handheld input equipment and display position control method and device of indication icon of handheld input equipment

An input device and display position technology, applied in the input/output process of data processing, instruments, electrical and digital data processing, etc., can solve problems such as affecting user experience, unnatural operation, deviation, etc.

Active Publication Date: 2019-11-22
SHENZHEN GRIDMORE CREATIVE TECH CO LTD
View PDF12 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the embodiment of the present application provides a method and device for controlling the display position of a handheld input device and its indicator icon, so as to solve the problem of the indicator icon in the prior art when the position pointed by the handheld input device moves inside and outside the screen. There is a deviation between the display position and the position pointed by the handheld input device, resulting in unnatural operation and affecting the user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Handheld input equipment and display position control method and device of indication icon of handheld input equipment
  • Handheld input equipment and display position control method and device of indication icon of handheld input equipment
  • Handheld input equipment and display position control method and device of indication icon of handheld input equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0082] There are multiple implementations for prefetching the screen features, including:

[0083] Method 1: Install a hardware identification device on the display device, for example, arrange a plurality of infrared LEDs around the screen 201, prefetch the number of LEDs and the spacing of the LEDs as screen features, extract the highlighted light spots in the first image 401, and convert the The light spots are matched according to the characteristics of the number of LEDs and the characteristics of the spacing of the LEDs, and the imaging area 402 of the screen can be determined.

[0084] Method 2: When capturing the first image 401, one or more special graphic objects are displayed on a specific position (such as the center of the screen) of the screen 201, and image features of these graphic objects are extracted in advance as screen features.

[0085] Way 3: At the same time or before the first image 401 is collected, the second image displayed on the screen 201 is coll...

Embodiment 1

[0090] The parameters of the mapping model in this embodiment include a first orientation, a mapping origin, and a mapping coefficient. The calculation method for obtaining the parameters of the mapping model is as follows image 3 shown, including:

[0091] In step S301, the first orientation is the orientation of the handheld input device when capturing the first image, wherein the orientation of the handheld input device includes a yaw angle and a pitch angle of the handheld input device;

[0092] In the mapping model of this embodiment, the yaw angle and pitch angle of the handheld input device are used to model the orientation of the handheld input device. like figure 2 As shown, according to the description habit of the aircraft attitude, if the pointing D of the handheld input device is the direction of the nose, then the RY axis is the pitch axis and the RZ axis is the yaw axis. When the handheld input device rotates around the pitch axis RY, its pointing The posit...

Embodiment 2

[0131] The mapping model of this embodiment is a three-dimensional model. According to the first image, the position of the screen in the three-dimensional space and the orientation of the handheld input device in the three-dimensional space can be three-dimensionally modeled, and the three-dimensional model is the mapping model of this embodiment. There are many known 3D modeling methods, such as 3D modeling with monocular vision, 3D modeling with binocular vision, or 3D modeling with depth cameras, etc., which will not be repeated here.

[0132] In the three-dimensional model, the curved surface can be modeled, so the screen reference surface 202 can be a plane or a curved surface. According to the three-dimensional model, the intersection point of the pointing line 204 of the handheld input device and the screen reference surface 202 can be obtained, and the intersection point is The pointing position corresponding to the pointing point, the pointing point where the interse...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Disclosed is a display position control method for an indication icon of handheld input equipment comprises the steps of collecting a first image pointed by the handheld input equipment, and extracting image features of the first image; identifying a screen imaging area in the first image according to the image features; establishing a mapping model according to the screen imaging area; determining a pointing position of a screen reference surface corresponding to the current pointing of the handheld input equipment according to the mapping model, and if the pointing position is located in thescreen, determining a display position of the indication icon according to the pointing position; otherwise, setting the display position of the indication icon in a preset screen edge range or hiding the indication icon. Therefore, in the using process, even if the pointing direction of the handheld input device moves inside and outside the screen at will multiple times, the display position ofthe indication icon is kept consistent with the actual pointing position of the handheld input device, a user does not need to control the action amplitude in the operation process, use is natural, and user experience is good.

Description

technical field [0001] The present application belongs to the field of hand-held input devices, and in particular relates to a method and device for controlling the display position of a hand-held input device and an indicator icon thereof. Background technique [0002] The hand-held input device is operated by the operator, and the operator can control an indicator icon to move on the computer graphical user interface (GUI) by manipulating its movement in three-dimensional space. [0003] One specific product of a handheld input device is an air mouse. For an air mouse, the above indicator icon is the mouse cursor. Unlike a desktop mouse, an air mouse does not require a support plane, and the operator can hold the air mouse to control the movement of the mouse cursor on the graphical user interface. Another specific product of the handheld input device is the digital wireless presenter. The wireless presenter is an important device in the conference room, which is used b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/0481G06F3/0346
CPCG06F3/0346G06F3/04817
Inventor 杨超峰
Owner SHENZHEN GRIDMORE CREATIVE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products