Projection interaction method based on pure machine vision positioning

Abstract

The invention discloses a projection interaction method based on pure machine vision positioning, and the method comprises the following steps: S1, carrying out the graying of a source image collectedby a vision sensor, and positioning the boundary and four vertexes of a projection region in the image; S2, establishing a coordinate mapping relationship from a source image coordinate system to a projection scene coordinate system, and solving a coordinate transformation matrix H; S3, detecting a contact position of an interactive carrier in the source image on a projection plane based on a target detection algorithm in deep learning; S4, mapping the contact to a projection scene coordinate system through the coordinate transformation relationship established in the step S2 to complete human-computer interaction. Aiming at the defect that a current projection interaction scheme based on infrared positioning depends on infrared equipment, a projection plane is positioned by adopting a method based on straight line detection, contact detection is realized by adopting a pure vision mode for positioning, interaction carrier coordinates are mapped into a projection scene coordinate system through a coordinate mapping relationship, and accurate interaction is realized.

Description

technical field [0001] The invention relates to the fields of projection interaction technology, image processing technology and deep learning, and in particular to a projection interaction method based on pure machine vision positioning. Background technique [0002] With the innovation of science and technology and the development of society, human-computer interaction technology methods emerge in an endless stream. The so-called human-computer interaction technology is the process of studying the information interaction between the computer and the human body. Different interaction methods have different application scenarios. For example, the mouse and keyboard can transmit information accurately and quickly, so they are widely used in the computer office field. The emergence of touch screens has brought a new transformation to the development of mobile phones; The system develops rapidly, so it has low cost, convenient operation and good display effect. This scheme is w...

AI Technical Summary

Problems solved by technology

The principle of this scheme is simple, and the system responds quickly. It is currently the most mature projection interaction method, but this scheme is highly dependent on the scene, and factors such as infrared light interference in natural light sources and unevenness of the interaction plane will directly interact with the effect.

In addition, the construction cost of the system based on infrared equipment is relatively high, and the interactive system of large scenes is often immobile, and the excessive dependence on equipment restricts the development of interactive projection products

Images