Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Speech-centric multimodal user interface design in mobile technology

a multimodal user interface and voice technology, applied in the field of speech-centric multimodal user interface design in mobile technology, to achieve the effect of facilitating converging on user intent, enhancing conveying of his/her intent, and increasing the probability of such inten

Active Publication Date: 2012-07-10
MICROSOFT TECH LICENSING LLC
View PDF21 Cites 334 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The multi-modal HCI system increases accuracy and speed in determining user intent, reduces the effort required for input, and provides feedback to improve interaction efficiency and accuracy, overcoming limitations of single or dual input modalities.

Problems solved by technology

For example, if environmental conditions result in excessive noise making speech recognition difficult, feedback can prompt the user to employ another modality (e.g., text or pen) as a primary form of information input.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech-centric multimodal user interface design in mobile technology
  • Speech-centric multimodal user interface design in mobile technology
  • Speech-centric multimodal user interface design in mobile technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016]The claimed subject matter is now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the claimed subject matter. It may be evident, however, that the claimed subject matter may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing the claimed subject matter.

[0017]As used in this application, the terms “component,”“module,”“system”, “interface”, “schema”, “algorithm” or the like are generally intended to refer to a computer-related entity, either hardware, a combination of hardware and software, software, or software in execution. For example, a component may be, but is not limited to being, a process running on a processor, a processor, an object, an exec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A multi-modal human computer interface (HCI) receives a plurality of available information inputs concurrently, or serially, and employs a subset of the inputs to determine or infer user intent with respect to a communication or information goal. Received inputs are respectively parsed, and the parsed inputs are analyzed and optionally synthesized with respect to one or more of each other. In the event sufficient information is not available to determine user intent or goal, feedback can be provided to the user in order to facilitate clarifying, confirming, or augmenting the information inputs.

Description

BACKGROUND OF THE INVENTION[0001]Graphical user interfaces (GUI) have significantly improved computer human interface by employing intuitive real-world metaphors. However, GUIs are still far from achieving a goal of allowing users to interact with computers without significant training. In addition, GUIs often rely heavily on a graphical display, keyboard and pointing devices that are not always available. Mobile computers have constraints on physical size and battery power, or present limitations due to hands-busy eyes-busy scenarios which make employment of traditional GUIs a challenge. In addition, with more and more computers designed for mobile usages and hence subject to physical size and hands-busy or eyes-busy constraints, traditional GUI faces an even greater challenge with respect to interaction therewith.[0002]Speech recognition technology enables a computer to automatically convert an acoustic signal uttered by users into textual words, freeing them from constraints of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(United States)
IPC IPC(8): G10L21/00G06F3/038G10L15/24
CPCG06F3/038G10L15/24G06F2203/0381
Inventor YU, DONGDENG, LI
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products