Navigation type experiment interaction device with cognitive function

Abstract

The invention provides a navigation type experiment interaction device with a cognitive function. The navigation type experiment interaction device comprises an information input sensing module, an information fusion module and an operation application module, wherein the information input sensing module obtains visual perception, obtains container information, completes tactile perception and auditory perception through voice input. And the information fusion module determines the multi-mode intention according to the visual sense, the tactile sense and the auditory sense acquired by the information input sensing module. The operation application module is applied to an experiment based on multi-modal intention understanding. According to the invention, perceptual expression of different states of three channels on interaction is realized; and matching the multi-modal information intersection set with the intention feature set to form a multi-modal intention understanding model, completing multi-modal fusion, prompting or guiding key operations through characters or voices, judging wrong operations according to user intentions and operation specifications, and prompting wrong operation behaviors or visually presenting consequences of the wrong operations.

Description

technical field [0001] The invention belongs to the technical field of experimental interaction, in particular to a navigational experimental interactive device with a cognitive function. Background technique [0002] With the development and application of human-computer interaction technology, computers have gradually changed our way of life. It is the process of realizing information exchange between humans and computers, and the machine provides users with a large amount of information and related prompts through output devices. Among them, multi-channel human-computer interaction has increasingly become a hot research field. Compared with the traditional single-channel interaction method, which has poor immersion, inaccurate input information, and low efficiency, the multi-channel interaction method can make up for the shortcomings of single-channel interaction. However, there is a greater application potential in natural interaction. The main purpose of the intellige...

AI Technical Summary

Problems solved by technology

[0004] According to the multi-modal fusion method, we found in the research that there are problems such as interference from the external environment, poor user experience, and low fusion efficiency.

Images