Lip language recognition method and system

Abstract

The invention discloses a lip language recognition method. The lip language recognition method comprises the steps of transmitting wireless signals directionally so that the wireless signals cover the face of a user; receiving wireless signals reflected by the face of the user, filtering the reflected wireless signals, and obtaining reflected signals of the mouth during the user's mouth motion; segmenting the reflected signals of the mouth, obtaining segmented signals, and obtaining waveform characteristic patterns of the segmented signals; enabling the segmented signals to be reflected signals each time a voice event is sent; comparing the similarity of the waveform characteristic patterns of the segmented signals with all mouth motion characteristic patterns sampled in advance, and reading the voice event corresponding to the mouth motion characteristic pattern highest in similarity. Correspondingly, an embodiment of the invention further provides a lip language recognition system. By the adoption of the lip language recognition method and system, the user's mouth motion can be detected through the wireless signals to achieve lip language recognition, and recognition efficiency and the accurate rate are improved.

Description

technical field [0001] The invention relates to the technical field of mobile communication, in particular to a lip language recognition method and system. Background technique [0002] The application of wireless detection and recognition is raised to a new level, including motion detection, gesture recognition, positioning, material classification and so on. By detecting and analyzing the reflection of the signal, the wireless detection and identification system can detect movement through walls and recognize human gestures, and even detect and locate tumors in the human body. [0003] However, in the prior art, the recognition of the user's speech is only realized through an acoustic sensor or a camera device. Systems employing this approach are expensive to deploy and have limited sensing and communication range. Additionally, systems using acoustic sensors or cameras have a delay in detection because the sensor has to record the sound and the camera has to take a pict...

AI Technical Summary

Problems solved by technology

[0003] However, in the prior art, the recognition of the user's speech is only realized through acoustic sensors or camera devices.

System deployment using this approach is expensive and has limited sensing and communication range

Additionally, systems using acoustic sensors or cameras will have a delay in detection because the sensor must record the sound and the camera must take the picture, process it, and send it to the receiver

At the same time, systems employing acoustic sensors cannot decode in too noisy environments

Images