Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-module interactive interface description method based on bionic proxy

A technology of interactive interface and agent module, applied in the field of information, can solve the problem of not being able to describe the ability of emotion recognition, not realizing the active perception of user emotion, etc., to achieve the effect of simple and easy-to-remember elements and attributes

Inactive Publication Date: 2009-07-08
BEIHANG UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing description language can only simply describe the action, voice and emotion expression ability of the bionic agent, but cannot describe the emotion recognition ability
That is to say, the existing language can only control the passive performance of bionic agents, that is, the expression of actions, voices and emotions according to the preset content, but does not realize the active perception of user emotions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-module interactive interface description method based on bionic proxy
  • Multi-module interactive interface description method based on bionic proxy
  • Multi-module interactive interface description method based on bionic proxy

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention is a bionic agent-based multi-mode interactive interface description method, including the design and implementation of multi-mode interactive markup language and perception module; wherein:

[0038] 1. Regarding the description of the multimodal interactive system using the multimodal interactive markup language, the steps are as follows:

[0039] Step 1: Definition of multimodal interactive markup language elements and attributes, including the inheritance of relevant elements and attributes in foreign existing markup languages ​​and the definition of elements and attributes in the perception module, image 3 The white box on the left is an element inherited from the Multi-model Presentation Markup Language (For details about DTD definitions, please refer to: Preendinger H, Descamps S, Ishizuka M, MPML: A Markup Language for Controlling theBehavior of Life-like Characters, Journal of Visual Languages ​​and Computing, Vol.15, No.2, 2004.183-203), ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention is a bionic agent-based multi-mode interaction interface description method, wherein the multi-mode interaction markup language describes the multi-mode interaction system as follows: (1) define the multi-mode interaction markup language label; (2) write the multi-mode interaction markup language code; (3) verify the validity of the written multimode interactive markup language code; (4) analyze the code through validity verification, and convert the multimode interactive markup language code into Vbscript code according to the rules; (5) ) embed the converted Vbscript code into the background of the corresponding web page, and call the related functions of the control module to realize the interaction. Among them, the implementation steps of the facial expression recognition control of the bionic agent perception module are as follows: (1) realize the face detector; (2) realize the special expression classifier; . The description method has the characteristics of simplicity, ease of use, and strong scalability, and enables ordinary users to easily develop a web-based bionic agent multi-mode interactive interface.

Description

(1) Technical field: [0001] The invention relates to a multi-model interaction interface description method based on a bionic agent, in particular to the design and implementation of a multi-model Interaction Markup Language (Multi-model Interaction Markup Language) and a bionic agent perception module, which belongs to the field of information technology. (two) background technology: [0002] Human-computer interaction has developed from the language command phase (CUI), graphic user interface (GUI) interaction phase to the natural and harmonious perceptual user interface (PUI) interaction phase. Multimodal interface is a new field of perceptual user interface research. In the multimodal interface, users can use natural interaction methods, such as voice, gestures, eyes and expressions, to interact with the computer and work collaboratively. However, a computer has no face and body, and cannot use the above-mentioned interaction methods. Therefore, bionic agents with mult...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/44G06K9/00
Inventor 毛峡李峥薛雨丽
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products