76 results about "Lip feature" patented technology

The invention relates to a lip language recognition method and device based on deep learning. The method includes the following steps that a voice signal and a video of a user are obtained, and the video is obtained by shooting the face of the user when the user sends the voice signal; the voice signal is identified by the voice recognition technology, and a first text is obtained; a to-be-recognized lip image sequence is obtained from the video; a lip feature vector is extracted from the to-be-recognized lip image sequence, and a second text is obtained according to the lip feature vector; the first text is corrected according to the second text, and a text corresponding to the voice signal of the user is obtained. According to the technical scheme, the problem of low accuracy of voice recognition in a noisy environment of the prior art can be solved.

The invention provides a method for lip feature identity authentication based on sparse coding. The method includes the following steps: a first step of in accordance with the position of the lip, extracting a lip image block from an input video; a second step of establishing a sparse coding featuring dictionary group, reconstructing the lip image block, calculating reconstructing errors; a third step of in accordance with the reconstructing errors, identifying and authenticating the identity of a speaking user. According to the invention, the method takes physiological structure of the lip and behavior habit double features into consideration simultaneously, gets more information from lip features, and increases accuracy of identification. The method adopts the sparse coding algorithm to better confront all kinds of noise caused by environment and personal factors of the speaker, and has a strong robustness. The method uses reconstructing of the sparse coding and the reconstructing errors as determining basis, and a computer has a high execution efficiency and rapid speed.

A collapsible device that can be quickly and easily mounted to certain types of music stands to allow viewing of up to six sheets of paper side by side. The device consists principally of four panel sections, two of which, in the expanded position, hang from the top horizontal edge of the music stand via lips provided for this purpose. Two lower panels, each attached via hinge to the upper panel directly above it, also include lip features at the bottom of the device for holding the sheets of paper. In the expanded position, the four panels cover and extend the viewable plane of the stand. The device can be folded on two perpendicular axes for compact storage and transport. Usable width combined with ease of transport and deployment differentiate the device from prior art, allowing the device to be treated as part of a musician's personal gear.

The invention discloses an infant emotion acquisition method and system. The method includes the steps of acquiring a face image of an infant; detecting a face position in the face image, and positioning eyebrow key points, eye key points and lip key points; obtaining eyebrow features according to the eyebrow key points, obtaining eye features according to the eye key points and obtaining lip features according to the lip key points; and determining the emotion of the infant through the eyebrow features, eye features and lip features. The method can realize the acquisition of the emotion of the infant and facilitates the management of emotions of the infant.

Disclosed in the invention is a mouth-movement-identification-based video marshalling method. According to the invention, on the basis of distribution differences of a tone (H) component, a saturation (S) component, and a brightness (V) component at lip color and skin color areas in a color image, three color feature vectors are selected; filtering and area connection processing is carried out on a binary image that has been processed by classification and threshold segmentation by a fisher classifier; a lip feature is matched with an animation picture lip feature in a material library; and a transition image between two frames is obtained by image interpolation synthesis, thereby realizing automatic video marshalling. The fisher classifier is constructed by selecting color information in the HSV color space reasonably, thereby obtaining more information contents for lip color and skin color area segmentation and enhancing reliability and adaptivity of mouth matching feature extraction in a complex environment. Moreover, with the image interpolation technology, the transition image between the two matched video frame pictures is generated, thereby improving the sensitivity and ornamental value of the video marshalling and realizing a smooth and complete video content.

Interior panels having integrated airbag doors for motor vehicles and methods for making such interior panels are provided herein. In one example, an interior panel comprises a substrate having outer and inner surfaces and an opening extending therethrough. An airbag chute-door assembly is mounted to the substrate and comprises a chute wall that at least partially surrounds an interior space. A door flap portion is pivotally connected to the chute wall and at least partially covers the opening. A perimeter flange extends from the chute wall and has a flange section that overlies the outer surface of the substrate. A molded-in lip feature extends from the flange section and contacts the outer surface to form a seal between the flange section and the substrate. A skin covering extends over the substrate and a foam is disposed between the skin covering and the substrate

The invention discloses a lip language recognition method combining a graph neural network and multi-feature fusion. The method comprises the following steps: firstly, extracting and constructing a face change sequence, marking face feature points, correcting a lip deflection angle, performing pre-processing through a trained lip semantic segmentation network, training a lip language recognition network through a graph structure of a single-frame feature point relationship and a graph structure of an adjacent-frame feature point relationship, and finally, generating a lip language recognition result through the trained lip language recognition network. CNN lip features and lip region feature points obtained after CNN extraction and feature fusion are performed on an identification network data set and a lip semantic segmentation network data set are subjected to the extraction and fusion by the GNN lip features obtained after GNN extraction and fusion and then input into BiGRU for identification, and the problems that time sequence feature extraction is difficult and lip feature extraction is affected by external factors are solved; the method effectively extracts the static features of the lip and the dynamic features of the lip change, and has the characteristics of high lip change feature extraction capability, high recognition result accuracy and the like.

The embodiment of the invention provides a lip-based person recognition method and device, a computer program product, a computer readable storage medium and electronic equipment. The person recognition method comprises the following steps: performing face detection on a to-be-recognized image, and extracting a lip region image from the to-be-recognized image according to a face detection result;performing feature extraction on the lip region image to obtain lip features; and performing character recognition on the to-be-recognized image according to the lip features. By adopting the technical scheme of the embodiment of the invention, the lip area of the person can be accurately identified by utilizing the better identification capability of the lip characteristics on the mouth of the person, and the accuracy of person identification is further improved.