Multi-touch system and method

Abstract

The invention discloses multi-touch system and method in the technical field of computer vision. The method includes: establishing spatial correspondence between a Kinect camera and a projection screen; allowing a computer to preprocess an image captured by the Kinect camera; extracting a hand image from the preprocessed image; acquiring coordinates and directions of fingers in the hand image by finger contact detection algorithm; tracking finger contacts by minimum distance first algorithm; recognizing the finger contacts by means of template matching to obtain corresponding operational information of the finger contacts; and transmitting the operational information to the computer which analyzes the operational information and controls corresponding operations for the image in the current screen according to analysis results. Man-machine interactive multi-touching is achieved by the Kinect camera detecting acts of human fingers on the projection screen, and replaces the mouse and keyboard, and the operation is well performed in a real-time manner. The projection screen needs to be planar only, and adaptability of screen operation is increased greatly.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a multi-touch system and method realized by a human-computer interaction method based on Kinect stereo vision. Background technique [0002] Kinect is the name officially released by Microsoft for the XBOX360 somatosensory peripherals. Specifically, it is a camera, but it is smarter and more advanced than ordinary cameras. The infrared sensor built into Kinect can perceive through black and white spectrum. Surrounding environment: pure black represents infinite distance, pure white represents infinite nearness, and the gray zone between black and white corresponds to the distance from the object to the sensor. It collects every point in the field of view and forms a depth-of-field image that represents the surrounding environment. The sensor generates a stream of depth-of-field images at several frames per second, recreating the surrounding environment in real-time 3D. ...

AI Technical Summary

Problems solved by technology

Although hardware equipment is improving and software technology is developing, there is still a long way to go to make this technology a truly comfortable, natural, and instant human-computer interaction, whether it is from software or hardware. That said, they still need to be developed and perfected.

[0004] Most of the current multi-touch systems are still in the stage of hardware perception (such as capacitive touch screen, infrared touch screen, etc.), and the sensing element determines whether there is input information by sensing the touch of the finger. There are defects, that is, the requirements for sensing materials are high, and different sensing materials have different effects on sensing accuracy, which affects the naturalness, comfort, and portability of human-computer interaction.

Images