Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A session robotic system

A robot system and facial expression recognition technology, applied in the field of humanoid robots, to achieve the effect of strong chatting function

Inactive Publication Date: 2008-05-28
SOUTH CHINA UNIV OF TECH
View PDF0 Cites 152 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The user can query by touching or using the mouse or keyboard, and cannot directly query information through sessions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A session robotic system
  • A session robotic system
  • A session robotic system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] hardware design

[0028] Conversational robot system consists of 1 high-performance PC, 2 CCD cameras, 5 DC servo motors, 1 high-speed dual-channel image input board, 1 data acquisition card, 1 microphone, 2 speakers, etc., 2 CCD The camera has a total of 5 degrees of freedom, which can imitate the up, down, left, and right movements of the two eyes of a person, and can also rotate like a human neck to track and recognize faces.

[0029] Camera Driver Module

[0030] When the user walks into the imaging areas of the two cameras, the camera driver module always positions the user at the imaging centers of the two cameras, just like a pair of human eyes.

[0031] Face Tracking and Recognition Module

[0032] Face tracking refers to the real-time and continuous estimation of the position and direction of the face in the video stream. It is mainly used in places that require continuous detection and recognition of faces. Face recognition refers to the feature information ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a conservational robot system. A human face tracking and recognizing module tracks and recognizes a human face image captured by a camera; a human facial expression recognizing module recognizes the expression; and semantic meaning is recognized after voice signals pass through a voice picking module and a voice recognizing module. The robot system understands human demands according to facial expressions and / or voice and then forms conservation statement through a knowledge inquiry module and generates voice for communication with humans through a voice generating module. The conservational robot system has voice recognizing and understanding abilities and can understand commands of users. The invention can be applied to schools, families, hotels, companies, airports, bus stations, docks, meeting rooms and so on for education, chat, conservation, consultation, etc. In addition, the invention can also help users with propaganda and introduction, guest reception, business inquiry, secretary service, foreign language interpretation, etc.

Description

technical field [0001] The invention relates to the field of humanoid robots, in particular to a conversational robot system. Background technique [0002] In many public places, some terminals are set up for information inquiry. It is generally composed of a touch screen and a computer. The user can query by touching or by using the mouse or keyboard, and cannot directly query information through sessions. Contents of the invention [0003] The purpose of the present invention is to provide a conversational robot system, which can realize the direct dialogue between human and the robot system, and can be used in public places for consultation. [0004] The conversational robot system of the present invention comprises camera and its driving module, face tracking and recognition module, facial expression recognition module, voice pickup module, voice recognition module, knowledge inquiry module, voice generation module; the human face image captured by camera Tracking a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/00G06F3/01G06F3/16G06K9/00
Inventor 肖南峰
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com