Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Man-machine interaction method based on estimation of human face posture

A technology of human-computer interaction and face pose, which is applied in the field of human-computer interaction based on face pose estimation, can solve the problem that human-computer interaction devices cannot fully meet different interactive environments and interactive groups

Inactive Publication Date: 2009-10-21
CHONGQING UNIV
View PDF0 Cites 65 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the fact that existing human-computer interaction devices cannot completely satisfy different interactive environments and interactive groups, the purpose of the present invention is to provide a human-computer interaction method based on face pose estimation, which utilizes facial feature point automatic positioning and human face Posture estimation and other technologies generate human-computer interaction information, and connect to the computer through the USB interface to form a human-computer interaction visual mouse device

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-machine interaction method based on estimation of human face posture
  • Man-machine interaction method based on estimation of human face posture
  • Man-machine interaction method based on estimation of human face posture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Below in conjunction with a non-limiting example the present invention will be further described

[0033] see figure 1 , figure 2 , image 3 , Figure 4 .

[0034] The image acquisition, timing generation and control of the present invention are realized by CPLD devices, the related algorithms of image preprocessing, feature point positioning and attitude estimation are completed by Da Vinci processor TMS32C6446 of TI Company, and the USB interface is realized by Cypress control chip. Complete the design of all algorithms and hardware modules according to the information processing flow, and simulate mouse operation to realize human-computer interaction.

[0035] The main modules are introduced as follows:

[0036] (1) Face image preprocessing

[0037] I. Image denoising. Due to the influence of the optical system or electronic devices, the image will inevitably be disturbed by noise, and denoising processing is required to improve the positioning accuracy of fe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a man-machine interaction method based on estimation of human face posture, comprising the steps as follows: human face image sequence is obtained by a camera, and five characteristic points such as two corners of eyes, two corners of mouth, and an apex of a nose are automatically extracted after pre-processing; taking a right side image as the reference, three deflection angles of human face in any image are estimated according to the positions and the corresponding relations of the five characteristic points; mouse pointer position and operation mode are defined by the posture information to generate man-machine interaction information; and a new visual mouse device is formed by being connected with a computer through a USB interface. As the supplement of traditional man-machine interaction method, the device is applicable to some special interaction groups (for example, disabled persons) and interaction environments (for example, multimedia game), and has obvious application value.

Description

technical field [0001] The present invention relates to a human-computer interaction method, in particular to a method for constructing a visual mouse device based on facial feature point positioning and attitude detection. Two corners of the eyes, two corners of the mouth and There are 5 feature points on the tip of the nose. Taking the position of the corresponding feature points of a frontal image as a reference, the three deflection angles of the real-time face image are estimated, and human-computer interaction information is generated, which is connected to the computer through the USB interface to form a human-computer interface. A visual mouse device for computer interaction. Background technique [0002] Human-computer interaction technology (Human-Computer Interaction Techniques) refers to the technology of realizing the dialogue between human and computer in an effective way through computer input and output devices. It includes that the machine provides a large ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01G06K9/00
Inventor 毛玉星张占龙何为成华安傅饶
Owner CHONGQING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products