Screen locating control method and device

Abstract

The invention discloses a screen location control method comprising the following steps of: (1) obtaining a reference image: obtaining or pre-collecting at least one screen reference image in real time, and taking the screen reference image as a standard image in image identification; (2) acquiring a screen image: pointing a location control device disclosed in the invention to a screen, digitalizing the screen image by an image acquisition unit in the location control device, and obtaining a series of screen acquisition images; (3) identifying an image: A, extracting a reference characteristic set, i.e., extracting the reference characteristic set from the screen reference image, and taking the reference characteristic set as a standard set in an image identification process; B, extracting and acquiring an image characteristic set, i.e., extracting the characteristics of the screen acquisition image by using a method which is same as the method for extracting the reference characteristic set to obtain an acquisition image characteristic set; and C, matching the acquisition image characteristic set with the reference characteristic set by using a matching algorithm; (4) calculating a position: according to the matching result and a current coordinate of the location control device, calculating a screen coordinate instructed by the location control device next time; and (5) identifying a focus: sending a new focus coordinate in a focus control module, and identifying the position of the focus according to the current state of the screen by the focus control module.

Description

technical field [0001] The invention relates to a screen positioning method and device, belonging to the field of human-computer interaction, specifically, a method and a device for directly positioning a screen by using computer vision and pattern recognition principles. Background technique [0002] As an input device, a screen pointing device is a device used to specify a position on the screen. For example, a mouse is a screen pointing device that uses the movement of the hand on another plane to control the position of the mouse cursor on the screen. As an important part of the human-computer interaction system, input devices have a huge impact on the human-computer interface and user experience. The popularity of the mouse has greatly improved the user experience, eventually leading to the popularity of graphical interface systems and replacing character interface systems in PCs and mobile devices. [0003] Currently, the mouse and trackpad are still the most importa...

AI Technical Summary

Problems solved by technology

But the mouse and trackpad also have outstanding shortcomings: the operation is not intuitive and natural

The advantage of this method is that it is easy to use, and there is no need to attach any other equipment except the camera; the disadvantage is that the positioning through the connection between the human eye and fingers is somewhat different from human habits, and it is not very intuitive to use; and, Through multiple steps to determine the position of human eyes and fingers, the errors of each step will accumulate and affect the final result

[0008] 1. It is necessary to install an infrared camera in front of the screen, and it cannot be blocked by the user, which brings inconvenience to the implementation, especially in desktop and portable applications

[0009] 2. The accuracy is affected by the accuracy of the camera, not as accurate as the mouse

[0010] 3. Calibration is required before use, which brings inconvenience to use

Images