Finger interaction identification system based on MEMS laser scanning

Abstract

The invention provides a finger interaction recognition system based on MEMS laser scanning. The system comprises a laser light source module which is used for emitting the RGB three-color laser; a galvanometer module which is used for receiving the laser emitted by the laser light source module and scanning the projection pictures line by line; a laser receiving module used for receiving the laser reflected during laser imaging; a depth image acquisition module which is used for acquiring a depth image with the same size as the projection pictures based on a TOF algorithm; a fingertip detection module which is used for obtaining the position and depth of a fingertip by using a deep learning algorithm; a hand image segmentation module which is used for segmenting a hand image from the depth image and determining the fingertip position; a finger action recognition module which is used for performing finger action recognition based on a neural network and a support vector machine classifier; and a finger interaction module which is used for operating and controlling the content change of the projection pictures based on the determined fingertip position. The system is small in size,is capable of being operated by hands, is convenient to carry, can realize the accurate fingertip positioning and gesture recognition, and can operate and control the projection content in real time through hands.

Description

technical field [0001] The invention belongs to the technical field of exchange projection, in particular to a finger interactive recognition system based on MEMS laser scanning. Background technique [0002] Existing interactive projection systems are roughly divided into two categories, industrial grade and household grade. Because industrial-grade projection requires high resolution and high definition, its volume and weight are very high, and it needs to be equipped with a camera for interaction and a screen suitable for projection. The system can only be fixed at a certain position in the room , does not support mobile anytime anywhere. [0003] Household-level projection systems are moderate in size, and most of them do not have functions such as gesture interaction. A few projection systems with interactive functions also have problems such as large size, simple interactive content, and insufficient clarity. [0004] The projection system in the prior art needs cumb...

AI Technical Summary

Problems solved by technology

[0003] Home-use projection systems are moderate in size, most of which do not have functions such as gesture interaction, and a few projection systems with interactive functions also have problems such as large size, simple interactive content, and insufficient clarity

[0004] The projection system in the prior art needs cumbersome operations such as focusing or automatic correction before starting, and consumes a lot of power and heats up seriously; the laser ranging function needs to be equipped with devices such as motors and polygonal mirrors, resulting in excessive volume and high power consumption ;The click operation of the human projection screen is not rigorous. It judges whether the fingertip has clicked through the depth detection of the fingertip. Because the small movements of the human hand cannot be captured well, it often leads to misoperation.

Images