Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A lip detection and reading method based on cascade feature extraction

A feature extraction and cascading technology, applied in cross-fields, achieves good accuracy and effectiveness, avoids huge calculations, and improves speed and accuracy

Active Publication Date: 2020-10-09
NANJING UNIV OF POSTS & TELECOMM
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] So far, most domestic related research is still in the laboratory stage, and a lot of research work is still needed for the detection and identification of the lip area.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A lip detection and reading method based on cascade feature extraction
  • A lip detection and reading method based on cascade feature extraction
  • A lip detection and reading method based on cascade feature extraction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Below in conjunction with accompanying drawing, technical scheme of the present invention is described in further detail:

[0042] figure 1 It is a lip detection and reading method flow based on cascade feature extraction. First, a video is input, and the image is grayed and normalized frame by frame, which is equivalent to preprocessing and is conducive to subsequent detection. The preprocessed video image is detected by the Viola Jones method, that is, the integral image of the input image is calculated first, and then the Haar feature is quickly calculated according to the integral image to obtain a weak classifier. These weak classifiers are cascaded to form a strong classifier to achieve detection. The classifier cascade structure is as follows: figure 2 shown.

[0043] Then, multi-level feature extraction is performed on the lip region image. Firstly, the threshold value binarization is performed on the image according to the color characteristics of the lip ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a lip detection and reading method based on cascade feature extraction. The invention first detects the lip area of ​​the input video through the Viola Jones method based on the Haar classifier and the adaptive advancement algorithm; then performs threshold binarization on the detection area according to the color characteristics of the lip area to realize lip area extraction , the image information is concentrated in the corner area of ​​the data matrix through the discrete cosine transform, and the threshold value screening method is used to extract the data; then, the dimensionality extraction of the features with the highest contribution value is performed through the principal component analysis method, so that the data is further reduced in dimension; the sample data is used Establish a sequence dictionary tree for recognition, use Levenstein distance for sequence similarity analysis and fuzzy matching; finally, combine the static features of each frame with the dynamic features of the video, and complete the lip area reading through dynamic sequence query. The invention can improve the speed and accuracy of lip reading through the multi-level extraction and dimension reduction of the image features of the lip area, and has good implementability and robustness.

Description

technical field [0001] The invention relates to a lip detection and reading method based on cascade feature extraction, which belongs to the cross technical fields of computer vision, image processing, human-computer interaction and the like. With the development of our country's economy and society and the advancement of science and technology, the detection and recognition methods of lips in video images have become an important content in the fields of social science and natural science. It has a wide range of applications in many fields such as smart cities, human-computer interaction, assisted speech recognition, and life and health, and is even more important for people with noise environments or hearing impairments. Background technique [0002] Computer lip-reading recognition refers to the use of computers to analyze the visual information of the speaker's lips to identify the content of his speech, and can be combined with auditory recognition to further improve th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/20G06F18/211G06F18/24
Inventor 王洲杰陈志岳文静刘玲于涛刘真
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com